-- Logs begin at Fri 2022-06-03 09:11:06 UTC, end at Fri 2022-06-03 10:17:37 UTC. -- Jun 03 09:42:01.605591 dv-cinder-797608-29-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 03 09:42:01.612912 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 09:42:01 2022] *** Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: nodename: dv-cinder-797608-29-iscsi Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: machine: x86_64 Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: clock source: unix Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: pcre jit disabled Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: detected number of CPU cores: 4 Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: current working directory: / Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: detected binary path: /usr/bin/uwsgi-core Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: your processes number limit is 47680 Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: your memory page size is 4096 bytes Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: detected max file descriptor number: 2048 Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: lock engine: pthread robust mutexes Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: thunder lock: enabled Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 03 09:42:01.617529 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 09:42:01.661667 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: Python main interpreter initialized at 0x56287cb519c0 Jun 03 09:42:01.661667 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: python threads support enabled Jun 03 09:42:01.661667 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: your server socket listen backlog is limited to 100 connections Jun 03 09:42:01.661667 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: your mercy for graceful operations on workers is 90 seconds Jun 03 09:42:01.662034 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 09:42:01.662034 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: *** Operational MODE: preforking *** Jun 03 09:42:01.662326 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: *** uWSGI is running in multiple interpreter mode *** Jun 03 09:42:01.662326 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: spawned uWSGI master process (pid: 80138) Jun 03 09:42:01.662528 dv-cinder-797608-29-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 03 09:42:01.664283 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: spawned uWSGI worker 1 (pid: 80148, cores: 1) Jun 03 09:42:01.664283 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: spawned uWSGI worker 2 (pid: 80149, cores: 1) Jun 03 09:42:01.664283 dv-cinder-797608-29-iscsi devstack@keystone.service[80138]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 09:42:07.345522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:42:07.345522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: from cryptography.utils import int_from_bytes Jun 03 09:42:07.346348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:42:07.346348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: from cryptography.utils import int_from_bytes Jun 03 09:42:07.346761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:42:07.346761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: from cryptography.utils import int_from_bytes Jun 03 09:42:07.346870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:42:07.346870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: from cryptography.utils import int_from_bytes Jun 03 09:42:07.395946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:42:07.396078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:42:07.396167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:42:07.396256 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:42:07.396340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] command line args: [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:42:07.396419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] command line args: [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:42:07.396580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:42:07.396661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:42:07.396740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ================================================================================ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:42:07.396813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ================================================================================ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:42:07.397000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] admin_token = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] admin_token = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] config_dir = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] config_dir = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] config_source = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] config_source = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] debug = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] debug = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.397986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.398246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.399558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.399638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.400943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] log_config_append = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] log_config_append = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] log_dir = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] log_dir = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] log_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] log_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.401981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.402895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.403954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] publish_errors = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] publish_errors = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.404976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] standard_threads = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] standard_threads = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.405922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] use_journal = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] use_journal = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] use_json = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] use_json = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] use_stderr = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] use_stderr = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.406999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] use_syslog = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.407068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] use_syslog = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.407224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.407309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:42:07.407476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.407564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.407712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.407789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.407966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.408985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.409980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.410926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.411910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412556 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.412889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.413882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.414943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.415028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.415170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.415247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.415431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.415544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.416999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.417953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.418904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.419991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.420141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.420291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.420417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.420532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.420646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.420768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.420886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.421982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.422924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.423986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.424944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.425918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.426941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.427883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.428955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.429950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430066 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.430906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.431030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.431631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.431759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.431876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.431998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.432941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.external = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.external = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.433939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.password = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.password = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.token = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.token = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.434933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.435992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.436943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.437921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.438994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.439955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440311 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.440910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.441947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.442916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.443992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.444943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.445829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.446051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.446166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.446296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.446296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.446517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.446633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.446781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.447407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.447542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.447661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.447777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.447902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.448966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.449924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.450887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.451959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.452910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.453922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454644 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.454893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.455960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.456908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.457986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.458940 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.459887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.460828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.461898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.462988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.463936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.464950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.465944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.466918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] role.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] role.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] role.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.467980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] role.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.468923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.469923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.470990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.471218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.471335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.471452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.471452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.471670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.471795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.471913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.472969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.473934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474644 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.474994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.475941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476066 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.476899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.477857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.478490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.478705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.478830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.478946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.479887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.480967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.481995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.482982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.483921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.484946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.485065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:42:07.485182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.485182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.485182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:42:07.485182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:42:07.511281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.511509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.511741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.511826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.511974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.512204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.520086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.520879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.548612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.548838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.549130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.549363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.601939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.602103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.651605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.651836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.651925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.652148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.718518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.718773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.718873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.718970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.719928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.742569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.742802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.742968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.743981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.744110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.744326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.755132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.755279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.768945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.769075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.769159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.769290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.769373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.769507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.769592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 09:42:07.787205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.787413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 09:42:07.787744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.787841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.787944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 09:42:07.788027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 09:42:07.788209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.788291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.788463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 09:42:07.788564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.788713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.788796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.788965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.789046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.789218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.789473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.799898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.800171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.800441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.800522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.800720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.800806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.801023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.801305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.809892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.811510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.814847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.815369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.816780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.822398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.822517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.822603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.822680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.822755 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.822880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823311 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.823966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.824065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.824147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.824147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.824147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.845816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.847539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.847820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.848713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.850451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.850728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.853176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.853420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.853698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.856096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.856383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.856672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.861126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.861409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.863956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.864241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.865909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.866314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.866597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.866878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.867152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.867426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.867699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.867965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.869243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.869633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.869941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.870223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.870499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.870767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.871033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.871298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.887367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.887646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.890106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.890382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.892239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.894928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.896101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.896393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.898766 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.899058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.901345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.903971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.904903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.907522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.910015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.910313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.910596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.910881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.911158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.911434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.912589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.912886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.913164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.913438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.913706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.914004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.930211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.930490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.930755 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.931527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.933143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.933420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.933679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.933970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.939470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.941174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.941446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.941861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.943559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.943828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.944496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.944775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.945055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.945351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.945627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.947394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.947683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.947959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.948240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.948525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.959538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.959819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.960097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.960374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.960653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.960926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.961209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.961767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.962046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.962343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.962619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.962896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.963166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.963446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.979228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.981242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.982490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.984498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.985789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.987403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.987779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.989023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.989300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.989382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.989576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.991011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.991286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.991560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.997464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:07.999107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:07.999413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.001028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:08.002312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.002599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.002880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.003163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.004216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.004503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.004782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.005052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.012748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:08.013035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.013416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.014622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:08.014905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.015282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.021550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:08.021855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.022135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.022409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.022679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.022964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.023237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.023469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 09:42:08.023553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.023747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.023829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.024919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.025097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.025180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.025362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.025637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.025928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.026193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.026454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.026717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.026967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 09:42:08.063005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56287cb519c0 pid: 80149 (default app) Jun 03 09:42:08.064675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56287cb519c0 pid: 80148 (default app) Jun 03 09:42:08.066260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c3f4-8278-4dec-b1f1-630f83be4c44 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:08.066558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c3f4-8278-4dec-b1f1-630f83be4c44 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:08.066839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c3f4-8278-4dec-b1f1-630f83be4c44 None None] PATH_INFO: `/v3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:08.071104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Fri Jun 3 09:42:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:16.099772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9294e-fabf-49e8-850b-c86472782b14 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:16.100327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9294e-fabf-49e8-850b-c86472782b14 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:16.100327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9294e-fabf-49e8-850b-c86472782b14 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:16.104784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:42:16.109968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:16.110347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:16.110538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:16.178638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: INFO dbcounter [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] Registered counter for database keystone Jun 03 09:42:16.200586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG oslo_db.sqlalchemy.engines [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:42:16.206847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writer thread running {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:42:16.485806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG passlib.handlers.bcrypt [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80149) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 09:42:16.486251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG passlib.handlers.bcrypt [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80149) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 09:42:16.541652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:16.543281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:16.669806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 09:42:16.852832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9294e-fabf-49e8-850b-c86472782b14 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:16.921942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: INFO dbcounter [None req-d6b9294e-fabf-49e8-850b-c86472782b14 None None] Registered counter for database keystone Jun 03 09:42:16.940915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG oslo_db.sqlalchemy.engines [None req-d6b9294e-fabf-49e8-850b-c86472782b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:42:16.947104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writer thread running {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:42:17.170064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9294e-fabf-49e8-850b-c86472782b14 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:17.174381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba8166-e0f6-4a5d-8001-877ff0f0b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:17.174989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8166-e0f6-4a5d-8001-877ff0f0b15b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:17.175277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8166-e0f6-4a5d-8001-877ff0f0b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:17.175564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8166-e0f6-4a5d-8001-877ff0f0b15b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:17.183548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba8166-e0f6-4a5d-8001-877ff0f0b15b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:17.234865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a7ba8166-e0f6-4a5d-8001-877ff0f0b15b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 09:42:17.235209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba8166-e0f6-4a5d-8001-877ff0f0b15b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:17.244477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Jun 3 09:42:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 09:42:17.250621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:17.265436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c50b-c0d3-427a-aabf-c4ff53ad0bda None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:17.269919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04a9ca-67ba-4254-9043-2c46e8f0c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:17.271312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a9ca-67ba-4254-9043-2c46e8f0c01a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:17.271602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a9ca-67ba-4254-9043-2c46e8f0c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:17.271895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a9ca-67ba-4254-9043-2c46e8f0c01a admin admin] PATH_INFO: `/v3/projects/2a9104f36ddb422fa7bc883d1d00818c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:17.273416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04a9ca-67ba-4254-9043-2c46e8f0c01a admin admin] RBAC: Authorizing `identity:get_project(project_id=2a9104f36ddb422fa7bc883d1d00818c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:17.325125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba04a9ca-67ba-4254-9043-2c46e8f0c01a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 09:42:17.325481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04a9ca-67ba-4254-9043-2c46e8f0c01a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:17.330121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Fri Jun 3 09:42:17 2022] GET /identity/v3/projects/2a9104f36ddb422fa7bc883d1d00818c => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:19.541175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da333-2cf0-4e2a-8428-4f898a77a225 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:19.541670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da333-2cf0-4e2a-8428-4f898a77a225 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:19.541835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da333-2cf0-4e2a-8428-4f898a77a225 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:19.545871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:19.551344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416b7f-fc54-4a6c-ae07-76b76b30583e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:19.551762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416b7f-fc54-4a6c-ae07-76b76b30583e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:19.551993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416b7f-fc54-4a6c-ae07-76b76b30583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:19.570975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-12416b7f-fc54-4a6c-ae07-76b76b30583e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:19.572542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-12416b7f-fc54-4a6c-ae07-76b76b30583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:19.580367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 09:42:19.602329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da333-2cf0-4e2a-8428-4f898a77a225 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:19.615596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da333-2cf0-4e2a-8428-4f898a77a225 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:19.620298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c59f5f-78de-4363-b2c0-ee57384d74c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:19.620925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59f5f-78de-4363-b2c0-ee57384d74c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:19.621215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59f5f-78de-4363-b2c0-ee57384d74c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:19.621500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59f5f-78de-4363-b2c0-ee57384d74c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:19.629067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c59f5f-78de-4363-b2c0-ee57384d74c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:19.630873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c59f5f-78de-4363-b2c0-ee57384d74c2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:19.639500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Jun 3 09:42:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:42:19.644868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12416b7f-fc54-4a6c-ae07-76b76b30583e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:19.653923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12416b7f-fc54-4a6c-ae07-76b76b30583e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:19.658267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3f39-4984-4a37-abc8-dddcf4e28131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:19.659126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3f39-4984-4a37-abc8-dddcf4e28131 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:19.659414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3f39-4984-4a37-abc8-dddcf4e28131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:19.659693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3f39-4984-4a37-abc8-dddcf4e28131 admin admin] PATH_INFO: `/v3/users/8ac41a57acdf4a3aa3f15e8d08769048` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:19.661082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3f39-4984-4a37-abc8-dddcf4e28131 admin admin] RBAC: Authorizing `identity:get_user(user_id=8ac41a57acdf4a3aa3f15e8d08769048)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:19.662948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3f39-4984-4a37-abc8-dddcf4e28131 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:19.664495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Fri Jun 3 09:42:19 2022] GET /identity/v3/users/8ac41a57acdf4a3aa3f15e8d08769048 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:21.955140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33571d-9e9c-4eba-8df7-34209b6a027d None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:21.955685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33571d-9e9c-4eba-8df7-34209b6a027d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:21.955685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33571d-9e9c-4eba-8df7-34209b6a027d None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:21.957046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:21.962409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85b9ba-1b52-4f99-9946-17dde64b0ce7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:21.962822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85b9ba-1b52-4f99-9946-17dde64b0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:21.962975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85b9ba-1b52-4f99-9946-17dde64b0ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:21.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7e85b9ba-1b52-4f99-9946-17dde64b0ce7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:21.980905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7e85b9ba-1b52-4f99-9946-17dde64b0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:21.991163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a83c-1214-401f-b3b5-50138391fd70 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:21.991456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a83c-1214-401f-b3b5-50138391fd70 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:21.991737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a83c-1214-401f-b3b5-50138391fd70 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:21.993078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:42:21.998987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:21.999272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:21.999549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.039251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG passlib.handlers.bcrypt [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80148) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 09:42:22.039684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG passlib.handlers.bcrypt [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80148) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 09:42:22.060326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:22.083373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85b9ba-1b52-4f99-9946-17dde64b0ce7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.086056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:22.088129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:22.106649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:22.187051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:22.187257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85b9ba-1b52-4f99-9946-17dde64b0ce7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.209318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.221534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.222379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.222669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.222951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.234309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:22.246118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:22.247249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:22.248084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:42:22.253056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.311418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc70c9-c47d-4f09-b7b9-08d631cee404 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.313702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:22.334522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:22.349097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.350147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.350443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.350724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.353058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9535816-473e-453b-8078-ffcb663fc966 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.387829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.388605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.388899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.389185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.390042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:22.390635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:22.391760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:22.405182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:22.410760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.421243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:22.422827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:22.506489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfb303-87a4-4c19-9e1b-1c60d0813024 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.519908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:42:22.525805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.528391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:22.542204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.543080 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.543367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.543653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] PATH_INFO: `/v3/users/8ac41a57acdf4a3aa3f15e8d08769048` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.544857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac41a57acdf4a3aa3f15e8d08769048)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:22.546359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:22.547964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/users/8ac41a57acdf4a3aa3f15e8d08769048 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:22.553147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.567275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:22.625150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61f9a-8808-4b57-962c-3a6ba1eed407 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.653945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861cd1-137d-4e25-bf03-f5f0b5c1d584 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.657474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.658290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.658593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.658849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.677622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:22.679765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:22.687620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.688408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.688697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.688972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.690185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:22.691625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:22.693213 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 10/18] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:22.699427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:42:22.700917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:22.701734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:22.702746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:42:22.702746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:42:22.702746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:42:22.702746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:22.702746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 9/19] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:42:22.707838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:22.763256 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:22.780205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:22.798750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a6539-4992-4ff2-ad97-3dfe096b158b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.807649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f8f6-6df9-476e-a882-a55116d0f857 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:22.831907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da926fe-6596-42a9-b630-4589237af91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.832549 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da926fe-6596-42a9-b630-4589237af91f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.832837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da926fe-6596-42a9-b630-4589237af91f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.833116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da926fe-6596-42a9-b630-4589237af91f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.833963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da926fe-6596-42a9-b630-4589237af91f None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.domain.id=default, user.id=8ac41a57acdf4a3aa3f15e8d08769048) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:22.834275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da926fe-6596-42a9-b630-4589237af91f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:22.835717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da926fe-6596-42a9-b630-4589237af91f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:22.841473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd9c6e-687e-4910-a880-ef049a63c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:22.842162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9c6e-687e-4910-a880-ef049a63c585 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:22.842452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9c6e-687e-4910-a880-ef049a63c585 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:22.842733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9c6e-687e-4910-a880-ef049a63c585 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:22.842819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/role_assignments?user.id=8ac41a57acdf4a3aa3f15e8d08769048&scope.domain.id=default&role.id=296e3902a56444e692e58d5eb525a587 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:22.843461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9c6e-687e-4910-a880-ef049a63c585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:22.843775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9c6e-687e-4910-a880-ef049a63c585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:22.845170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9c6e-687e-4910-a880-ef049a63c585 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:22.869551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:25.543200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f80e-5133-45a4-bcaf-0d60b1a63615 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:25.544206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f80e-5133-45a4-bcaf-0d60b1a63615 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:25.544710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f80e-5133-45a4-bcaf-0d60b1a63615 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:25.546332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:25.551996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b35e6-2e31-4e17-b071-f203af471e46 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:25.552410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b35e6-2e31-4e17-b071-f203af471e46 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:25.552559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b35e6-2e31-4e17-b071-f203af471e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:25.574736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e67b35e6-2e31-4e17-b071-f203af471e46 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:25.576160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e67b35e6-2e31-4e17-b071-f203af471e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:25.660237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 11/23] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:25.695012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f80e-5133-45a4-bcaf-0d60b1a63615 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:25.725986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4ef4-aa91-45e9-84fe-560c9a1e0425 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:25.726613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4ef4-aa91-45e9-84fe-560c9a1e0425 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:25.727115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4ef4-aa91-45e9-84fe-560c9a1e0425 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:25.729535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:25.736410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb8bab-66d8-48e3-bfd1-7b6f2426aa83 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:25.737256 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb8bab-66d8-48e3-bfd1-7b6f2426aa83 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:25.739094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb8bab-66d8-48e3-bfd1-7b6f2426aa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:25.786075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bdeb8bab-66d8-48e3-bfd1-7b6f2426aa83 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:25.787826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bdeb8bab-66d8-48e3-bfd1-7b6f2426aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:25.854155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:25.894559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:25.955422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f80e-5133-45a4-bcaf-0d60b1a63615 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:25.955925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb8bab-66d8-48e3-bfd1-7b6f2426aa83 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:26.023824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:26.025150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.025442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.025724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.062676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:26.078451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:26.079332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:26.080075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 13/26] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:26.090757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:26.107011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:26.115205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb8bab-66d8-48e3-bfd1-7b6f2426aa83 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:26.175365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e8c0-94c6-4594-9f8b-2ef25f62fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:26.176104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e8c0-94c6-4594-9f8b-2ef25f62fc3d None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.176394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e8c0-94c6-4594-9f8b-2ef25f62fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.176728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e8c0-94c6-4594-9f8b-2ef25f62fc3d None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.177504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e8c0-94c6-4594-9f8b-2ef25f62fc3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:26.179298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e8c0-94c6-4594-9f8b-2ef25f62fc3d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:26.336126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4debe-ab10-40d7-a156-389b36f15f9f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:26.351176 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 14/27] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 3 09:42:25 2022] POST /identity/v3/roles => generated 225 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:26.354642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ee4d-27b4-4a75-8800-05732360f656 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.354642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ee4d-27b4-4a75-8800-05732360f656 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.354642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ee4d-27b4-4a75-8800-05732360f656 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.355061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 15/28] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:26.356270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3ed46-26a8-41ca-ad40-fcc2540229fc None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.356547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3ed46-26a8-41ca-ad40-fcc2540229fc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.356832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3ed46-26a8-41ca-ad40-fcc2540229fc None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.358263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 16/29] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:26.363039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeecb3e-4639-4989-b7d2-6a54fae3caa6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.363333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeecb3e-4639-4989-b7d2-6a54fae3caa6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.363623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeecb3e-4639-4989-b7d2-6a54fae3caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.392437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fbeecb3e-4639-4989-b7d2-6a54fae3caa6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:26.394395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fbeecb3e-4639-4989-b7d2-6a54fae3caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:26.434209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:26.450552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084026b-9042-459c-9ba1-994622032413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:26.451250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084026b-9042-459c-9ba1-994622032413 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.451539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084026b-9042-459c-9ba1-994622032413 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.451821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084026b-9042-459c-9ba1-994622032413 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.452591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084026b-9042-459c-9ba1-994622032413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:26.452896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084026b-9042-459c-9ba1-994622032413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:26.454568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084026b-9042-459c-9ba1-994622032413 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:26.475743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 14/30] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:26.477038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c5d-63bd-4f97-b2ce-94fda7770eda None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.477391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c5d-63bd-4f97-b2ce-94fda7770eda None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.478222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c5d-63bd-4f97-b2ce-94fda7770eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.482760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 17/31] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:26.484231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeecb3e-4639-4989-b7d2-6a54fae3caa6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:26.530953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a3f95c5d-63bd-4f97-b2ce-94fda7770eda None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:26.532192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a3f95c5d-63bd-4f97-b2ce-94fda7770eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:26.611209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeecb3e-4639-4989-b7d2-6a54fae3caa6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:26.667542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:26.670675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:26.672898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.673328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.673711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] PATH_INFO: `/v3/users/8ac41a57acdf4a3aa3f15e8d08769048` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.675792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] RBAC: Authorizing `identity:get_user(user_id=8ac41a57acdf4a3aa3f15e8d08769048)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:26.677394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:26.678303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 15/32] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:26.679449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 18/33] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:26 2022] GET /identity/v3/users/8ac41a57acdf4a3aa3f15e8d08769048 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:26.679838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95c5d-63bd-4f97-b2ce-94fda7770eda None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:26.685557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:26.786170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:26.796576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95c5d-63bd-4f97-b2ce-94fda7770eda None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:26.820749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a21d3-fa19-49f0-bc80-ef140621ff9a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:26.833556 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:26.834529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.835009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.835488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.836442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:26.838124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:26.861305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:26.862220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:26.862618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:26.863045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:26.864425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:26.866229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:26.867920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 19/34] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:26.874737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:26.980841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 16/35] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 3 09:42:26 2022] POST /identity/v3/roles => generated 219 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:26.981607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:26.993611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cdec-4e40-440a-8e1a-b7ab7a2ebd4d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:26.995857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:27.035030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff838b14-22f4-4b9d-b819-f492e01de60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:27.036266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff838b14-22f4-4b9d-b819-f492e01de60b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.036771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff838b14-22f4-4b9d-b819-f492e01de60b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.037255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff838b14-22f4-4b9d-b819-f492e01de60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.050714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff838b14-22f4-4b9d-b819-f492e01de60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:27.052608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff838b14-22f4-4b9d-b819-f492e01de60b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:27.053327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ff838b14-22f4-4b9d-b819-f492e01de60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:42:27.073867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:27.074728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:27.075550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:42:27.075550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:42:27.075550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:42:27.075550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:27.077611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 20/36] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:27.079247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63673f-4c3e-4081-a9b4-f93afd638279 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.079814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63673f-4c3e-4081-a9b4-f93afd638279 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.080309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63673f-4c3e-4081-a9b4-f93afd638279 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.081976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 21/37] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:27.085127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63673f-4c3e-4081-a9b4-f93afd638279 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:27.118983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff933f8-5a13-422a-bbfb-b639c644a614 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:27.159746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dba41-940e-4766-87ae-3b883bacc2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:27.160652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dba41-940e-4766-87ae-3b883bacc2d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.160959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dba41-940e-4766-87ae-3b883bacc2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.161216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dba41-940e-4766-87ae-3b883bacc2d1 None admin] PATH_INFO: `/v3/domains/default/users/8ac41a57acdf4a3aa3f15e8d08769048/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.163623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dba41-940e-4766-87ae-3b883bacc2d1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8ac41a57acdf4a3aa3f15e8d08769048, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:27.165770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dba41-940e-4766-87ae-3b883bacc2d1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:27.189049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 17/38] 10.222.0.45 () {58 vars in 1361 bytes} [Fri Jun 3 09:42:26 2022] PUT /identity/v3/domains/default/users/8ac41a57acdf4a3aa3f15e8d08769048/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:42:27.189049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2954-d788-40bc-a384-144f5ac7cff1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.189049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2954-d788-40bc-a384-144f5ac7cff1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.189049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2954-d788-40bc-a384-144f5ac7cff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.208130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-708f2954-d788-40bc-a384-144f5ac7cff1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:27.209873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-708f2954-d788-40bc-a384-144f5ac7cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:27.229048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63673f-4c3e-4081-a9b4-f93afd638279 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:27.283027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28271631-4c74-425a-a69b-5bdc96a570da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:27.283749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271631-4c74-425a-a69b-5bdc96a570da None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.284039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271631-4c74-425a-a69b-5bdc96a570da None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.284318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271631-4c74-425a-a69b-5bdc96a570da None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.285065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28271631-4c74-425a-a69b-5bdc96a570da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:27.285377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28271631-4c74-425a-a69b-5bdc96a570da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:27.287111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28271631-4c74-425a-a69b-5bdc96a570da None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:27.307202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 22/39] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:27.309064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da59d7-71d3-4395-b9ff-6b6580fcefb6 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.309359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da59d7-71d3-4395-b9ff-6b6580fcefb6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.309636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da59d7-71d3-4395-b9ff-6b6580fcefb6 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.311245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 23/40] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:27.316035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da59d7-71d3-4395-b9ff-6b6580fcefb6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:27.318574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 18/41] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:27.319746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc621de-b2f7-46fe-b2e0-c135fddcba73 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.320045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc621de-b2f7-46fe-b2e0-c135fddcba73 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.320334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc621de-b2f7-46fe-b2e0-c135fddcba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.339409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:27.342758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1bc621de-b2f7-46fe-b2e0-c135fddcba73 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:27.345251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1bc621de-b2f7-46fe-b2e0-c135fddcba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:27.404368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:27.431249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 19/42] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:27.432094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc621de-b2f7-46fe-b2e0-c135fddcba73 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:27.447882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da59d7-71d3-4395-b9ff-6b6580fcefb6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:27.487041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:27.487708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.487994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.488272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.489407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:27.491344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:27.524005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 24/43] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:42:27 2022] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:27.524863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:27.550767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc621de-b2f7-46fe-b2e0-c135fddcba73 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:27.600065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:27.600761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.601049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.601328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.602148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:27.603027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:27.604978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:27.631097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 20/44] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 3 09:42:27 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:27.656042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3da08-18ac-4b09-bb8c-ecc76f7de961 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:27.704320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb5d24-282f-49a9-b32f-2e52511da99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:27.705478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5d24-282f-49a9-b32f-2e52511da99a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.705977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5d24-282f-49a9-b32f-2e52511da99a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.706439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5d24-282f-49a9-b32f-2e52511da99a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.708136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb5d24-282f-49a9-b32f-2e52511da99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:27.710297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb5d24-282f-49a9-b32f-2e52511da99a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:27.712867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 25/45] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:27.718928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:27.762241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:27.837179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40002ad-35d1-4ad5-a0f6-fe7dda7d1194 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:27.872752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6dfce-dd8d-404f-91c7-e3c630423016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:27.873419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6dfce-dd8d-404f-91c7-e3c630423016 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:27.873711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6dfce-dd8d-404f-91c7-e3c630423016 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:27.874020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6dfce-dd8d-404f-91c7-e3c630423016 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:27.874738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6dfce-dd8d-404f-91c7-e3c630423016 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:27.876216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6dfce-dd8d-404f-91c7-e3c630423016 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:27.904471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 21/46] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:42:27 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:42:29.508417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcb4f4-cc0d-4a6c-9fdf-7df2ad201370 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:29.509409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcb4f4-cc0d-4a6c-9fdf-7df2ad201370 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:29.509518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcb4f4-cc0d-4a6c-9fdf-7df2ad201370 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:29.510858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 26/47] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:29.516089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5b11-9098-486b-96d6-efe79fbce2a2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:29.516516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5b11-9098-486b-96d6-efe79fbce2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:29.516793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5b11-9098-486b-96d6-efe79fbce2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:29.534226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2f8f5b11-9098-486b-96d6-efe79fbce2a2 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:29.535385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2f8f5b11-9098-486b-96d6-efe79fbce2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:29.599230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 22/48] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:29.622312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcb4f4-cc0d-4a6c-9fdf-7df2ad201370 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:29.723885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcb4f4-cc0d-4a6c-9fdf-7df2ad201370 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:29.756835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:29.757627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:29.757954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:29.758237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:29.760762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:29.771925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:29.781006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:29.782021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:29.782955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 27/49] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:29.787927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5b11-9098-486b-96d6-efe79fbce2a2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:29.806521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:29.890200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5b11-9098-486b-96d6-efe79fbce2a2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:29.923526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:29.924199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:29.924492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:29.924777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:29.925527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:29.925873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:29.927278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:29.935820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 23/50] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:29.941222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:30.046400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90047-2ffb-4878-936b-ad19031deae1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:30.078457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07f401-a19b-498c-aa0a-ff60dc3cdfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:30.079322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f401-a19b-498c-aa0a-ff60dc3cdfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:30.079607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f401-a19b-498c-aa0a-ff60dc3cdfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:30.079885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f401-a19b-498c-aa0a-ff60dc3cdfa1 None admin] PATH_INFO: `/v3/users/8ac41a57acdf4a3aa3f15e8d08769048` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:30.081049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07f401-a19b-498c-aa0a-ff60dc3cdfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac41a57acdf4a3aa3f15e8d08769048)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:30.082542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07f401-a19b-498c-aa0a-ff60dc3cdfa1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:30.084152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 28/51] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:29 2022] GET /identity/v3/users/8ac41a57acdf4a3aa3f15e8d08769048 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:30.089523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:30.152481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60b2c0-a4e5-4eb2-831f-17e8cf17f037 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:30.152807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60b2c0-a4e5-4eb2-831f-17e8cf17f037 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:30.153096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60b2c0-a4e5-4eb2-831f-17e8cf17f037 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:30.154515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 29/52] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:42:30.159219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdfbd0-11c5-4866-acc5-43cfab18ee2e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:30.159513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdfbd0-11c5-4866-acc5-43cfab18ee2e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:30.159800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdfbd0-11c5-4866-acc5-43cfab18ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:30.176160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2dfdfbd0-11c5-4866-acc5-43cfab18ee2e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:30.176746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:30.177458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2dfdfbd0-11c5-4866-acc5-43cfab18ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:30.196878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1520379-888b-42c6-abb8-5bc7c5d48b4e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:30.230427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:30.231224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:30.231508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:30.231787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:30.232944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:30.234262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:30.234535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:30.236179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 24/53] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:30.242079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:30.249471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 30/54] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:30.272441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdfbd0-11c5-4866-acc5-43cfab18ee2e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:30.341048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58dc0-ea0a-4acd-8f2e-d365015c411a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:30.370988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdfbd0-11c5-4866-acc5-43cfab18ee2e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:30.374065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:30.374720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:30.375006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:30.375285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:30.376108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.domain.id=default, user.id=8ac41a57acdf4a3aa3f15e8d08769048) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:30.376422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:30.377891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:30.383838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 25/55] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Jun 3 09:42:30 2022] GET /identity/v3/role_assignments?user.id=8ac41a57acdf4a3aa3f15e8d08769048&scope.domain.id=default&role.id=296e3902a56444e692e58d5eb525a587 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:30.408380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c82521-9f5b-4106-9bf7-9ad51bc3e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:30.409201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82521-9f5b-4106-9bf7-9ad51bc3e880 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:30.409490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82521-9f5b-4106-9bf7-9ad51bc3e880 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:30.409793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82521-9f5b-4106-9bf7-9ad51bc3e880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:30.411104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c82521-9f5b-4106-9bf7-9ad51bc3e880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:30.412621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c82521-9f5b-4106-9bf7-9ad51bc3e880 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:30.414559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 31/56] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:30.420322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:30.436884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:30.529023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d330-3d37-4f00-95f7-cc3d945bb4c5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:30.563565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994910f-b2f1-48cd-9e12-7a198301dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:30.564242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994910f-b2f1-48cd-9e12-7a198301dc52 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:30.564530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994910f-b2f1-48cd-9e12-7a198301dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:30.564808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994910f-b2f1-48cd-9e12-7a198301dc52 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:30.565523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994910f-b2f1-48cd-9e12-7a198301dc52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:30.567030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994910f-b2f1-48cd-9e12-7a198301dc52 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:30.594342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 26/57] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Jun 3 09:42:30 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:32.813521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326f8b-e6e5-4911-b539-8f27a64aa72f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:32.814090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326f8b-e6e5-4911-b539-8f27a64aa72f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:32.814180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326f8b-e6e5-4911-b539-8f27a64aa72f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:32.815503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 32/58] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:32.820915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0ecc-65af-4d69-91cb-c7d9dbf41e6e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:32.821320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0ecc-65af-4d69-91cb-c7d9dbf41e6e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:32.821488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0ecc-65af-4d69-91cb-c7d9dbf41e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:32.838142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5ccf0ecc-65af-4d69-91cb-c7d9dbf41e6e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:32.839317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5ccf0ecc-65af-4d69-91cb-c7d9dbf41e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:32.897368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:32.906350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 27/59] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:32.931341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326f8b-e6e5-4911-b539-8f27a64aa72f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:32.990842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:33.032035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326f8b-e6e5-4911-b539-8f27a64aa72f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:33.064474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0981cc-ec77-4ef7-a02e-38c587e580e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:33.065199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0981cc-ec77-4ef7-a02e-38c587e580e1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:33.065489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0981cc-ec77-4ef7-a02e-38c587e580e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:33.065788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0981cc-ec77-4ef7-a02e-38c587e580e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:33.066975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0981cc-ec77-4ef7-a02e-38c587e580e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:33.068478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0981cc-ec77-4ef7-a02e-38c587e580e1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:33.070110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 33/60] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:33.076066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0ecc-65af-4d69-91cb-c7d9dbf41e6e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:33.180232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0ecc-65af-4d69-91cb-c7d9dbf41e6e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:33.212301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bfb75-db86-4348-86f3-d0e986e8fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:33.212964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bfb75-db86-4348-86f3-d0e986e8fc86 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:33.213250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bfb75-db86-4348-86f3-d0e986e8fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:33.213528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bfb75-db86-4348-86f3-d0e986e8fc86 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:33.214269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bfb75-db86-4348-86f3-d0e986e8fc86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:33.215732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bfb75-db86-4348-86f3-d0e986e8fc86 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:33.240675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 28/61] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:42:33 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:36.402592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594407a6-123c-401f-ad96-0428c4fd185a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:36.403457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594407a6-123c-401f-ad96-0428c4fd185a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:36.403976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594407a6-123c-401f-ad96-0428c4fd185a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:36.405543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 34/62] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:36.410949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0f3d-2260-4ec6-8e85-a975972ea51d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:36.411772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0f3d-2260-4ec6-8e85-a975972ea51d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:36.412255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0f3d-2260-4ec6-8e85-a975972ea51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:36.433563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6cdc0f3d-2260-4ec6-8e85-a975972ea51d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:36.435044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6cdc0f3d-2260-4ec6-8e85-a975972ea51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:36.505769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:36.532110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 29/63] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:36.569149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594407a6-123c-401f-ad96-0428c4fd185a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:36.700475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594407a6-123c-401f-ad96-0428c4fd185a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:36.737461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:36.754476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951aeb1-ecac-4419-a596-a902f8bad770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:36.755291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951aeb1-ecac-4419-a596-a902f8bad770 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:36.755577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951aeb1-ecac-4419-a596-a902f8bad770 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:36.755855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951aeb1-ecac-4419-a596-a902f8bad770 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:36.770683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951aeb1-ecac-4419-a596-a902f8bad770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b951aeb1-ecac-4419-a596-a902f8bad770 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:36.778834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:36.779741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:36.780905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 35/64] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:36.786284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0f3d-2260-4ec6-8e85-a975972ea51d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:36.802207 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a6cbc-3604-425b-b424-535af45450be None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:36.802522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a6cbc-3604-425b-b424-535af45450be None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:36.802803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a6cbc-3604-425b-b424-535af45450be None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:36.804166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 36/65] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:36.810727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af084a8-23c2-46e7-924d-389f5a0622a3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:36.811034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af084a8-23c2-46e7-924d-389f5a0622a3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:36.811298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af084a8-23c2-46e7-924d-389f5a0622a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:36.841981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4af084a8-23c2-46e7-924d-389f5a0622a3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:36.843199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4af084a8-23c2-46e7-924d-389f5a0622a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:36.917682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0f3d-2260-4ec6-8e85-a975972ea51d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:36.954667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:36.955564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:36.955994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:36.956434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:36.957326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:36.957794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:36.959494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:36.968585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 30/66] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:36.978370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.052025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 37/67] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:37.070131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.092108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af084a8-23c2-46e7-924d-389f5a0622a3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.132460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235cac5-036c-4eb4-90fc-52b828d02851 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.172938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a016a3-9148-4483-a3bd-8964b5b2de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.173865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a016a3-9148-4483-a3bd-8964b5b2de5b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.174157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a016a3-9148-4483-a3bd-8964b5b2de5b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.174443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a016a3-9148-4483-a3bd-8964b5b2de5b None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.189262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a016a3-9148-4483-a3bd-8964b5b2de5b None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:37.190780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a016a3-9148-4483-a3bd-8964b5b2de5b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:37.197381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 31/68] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:36 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:37.198867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729fe2-b051-46fe-86c0-2249f5c5ed28 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.199308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729fe2-b051-46fe-86c0-2249f5c5ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.199736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729fe2-b051-46fe-86c0-2249f5c5ed28 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.201385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 32/69] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:37.204121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af084a8-23c2-46e7-924d-389f5a0622a3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.206431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60729fe2-b051-46fe-86c0-2249f5c5ed28 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.223166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.241874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba61dd6-6027-477f-bdbb-97900924e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.242981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba61dd6-6027-477f-bdbb-97900924e50f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.243450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba61dd6-6027-477f-bdbb-97900924e50f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.243893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba61dd6-6027-477f-bdbb-97900924e50f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.255392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba61dd6-6027-477f-bdbb-97900924e50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-eba61dd6-6027-477f-bdbb-97900924e50f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:37.263916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:37.264946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:37.265856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:37.267831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 38/70] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:42:37.269190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70f11b-d76b-4257-b2e4-a3bf4f9c07a1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.269625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70f11b-d76b-4257-b2e4-a3bf4f9c07a1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.270061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70f11b-d76b-4257-b2e4-a3bf4f9c07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.288715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3a70f11b-d76b-4257-b2e4-a3bf4f9c07a1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:37.290796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3a70f11b-d76b-4257-b2e4-a3bf4f9c07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:37.320746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.325944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60729fe2-b051-46fe-86c0-2249f5c5ed28 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.363545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dd9a-be0a-42c4-902d-1d8684a51fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.364204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dd9a-be0a-42c4-902d-1d8684a51fdd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.364495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dd9a-be0a-42c4-902d-1d8684a51fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.364621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 39/71] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:37.365461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70f11b-d76b-4257-b2e4-a3bf4f9c07a1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.369965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dd9a-be0a-42c4-902d-1d8684a51fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.445353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dd9a-be0a-42c4-902d-1d8684a51fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:37.447416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867dd9a-be0a-42c4-902d-1d8684a51fdd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:37.479935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70f11b-d76b-4257-b2e4-a3bf4f9c07a1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.488939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.513543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa028b-1ea5-4b35-9881-88ad3e4eaadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.514237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa028b-1ea5-4b35-9881-88ad3e4eaadf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.514522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa028b-1ea5-4b35-9881-88ad3e4eaadf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.514801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa028b-1ea5-4b35-9881-88ad3e4eaadf None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.515548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa028b-1ea5-4b35-9881-88ad3e4eaadf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:37.515857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa028b-1ea5-4b35-9881-88ad3e4eaadf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:37.517235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa028b-1ea5-4b35-9881-88ad3e4eaadf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:37.529070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 40/72] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:37.530392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc513e-1b9e-4dc1-9f3a-05dc2a4e6527 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.530687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc513e-1b9e-4dc1-9f3a-05dc2a4e6527 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.530968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc513e-1b9e-4dc1-9f3a-05dc2a4e6527 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.532189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 41/73] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:37.532881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc513e-1b9e-4dc1-9f3a-05dc2a4e6527 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.544530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.548627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 33/74] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:37.550550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a5a3b-9c10-4121-bb31-a3cb829c07a1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.551012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a5a3b-9c10-4121-bb31-a3cb829c07a1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.551582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a5a3b-9c10-4121-bb31-a3cb829c07a1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.553078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 34/75] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:37.557491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a5a3b-9c10-4121-bb31-a3cb829c07a1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.637210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc513e-1b9e-4dc1-9f3a-05dc2a4e6527 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.654000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a5a3b-9c10-4121-bb31-a3cb829c07a1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.670516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd4973-7fdf-445e-af52-058b2a47c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.671323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4973-7fdf-445e-af52-058b2a47c23d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.671617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4973-7fdf-445e-af52-058b2a47c23d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.671899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4973-7fdf-445e-af52-058b2a47c23d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.682720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd4973-7fdf-445e-af52-058b2a47c23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:37.688736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.689598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.689933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.690219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] PATH_INFO: `/v3/users/8ac41a57acdf4a3aa3f15e8d08769048` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-76bd4973-7fdf-445e-af52-058b2a47c23d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:37.690739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:37.691579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:37.692308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:37.692875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac41a57acdf4a3aa3f15e8d08769048)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:37.692939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 42/76] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:37.693495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:37.693596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818e6f-3bca-4ad2-befd-c71159a609ff None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.693596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818e6f-3bca-4ad2-befd-c71159a609ff None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.693722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818e6f-3bca-4ad2-befd-c71159a609ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.694707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 35/77] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/users/8ac41a57acdf4a3aa3f15e8d08769048 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:37.695298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.716375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-22818e6f-3bca-4ad2-befd-c71159a609ff None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:37.717572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-22818e6f-3bca-4ad2-befd-c71159a609ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:37.741264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.760097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.784941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 43/78] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:37.793952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6498-dad8-404a-b222-3d63a4bb1694 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.793952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6498-dad8-404a-b222-3d63a4bb1694 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.793952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6498-dad8-404a-b222-3d63a4bb1694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.803004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f9db6498-dad8-404a-b222-3d63a4bb1694 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:37.803431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a7d7a-e5a6-412f-9cc7-51b3671234c2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.804160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f9db6498-dad8-404a-b222-3d63a4bb1694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:37.837919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.838947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.839435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.839922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.842064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:37.844452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:37.846256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 36/79] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:37.848722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.879377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 44/80] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:37.880240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6498-dad8-404a-b222-3d63a4bb1694 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:37.957455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559921-42dc-4961-b20d-62fc4ee6a3c0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.971339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:37.981771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6498-dad8-404a-b222-3d63a4bb1694 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:37.992767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:37.993393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:37.993688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:37.994004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:37.997481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.015759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.016513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.016699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.016981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.017719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:38.018059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.019442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.027988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 45/81] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:38.028836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.067337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.068824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.128417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9d2-49ea-4967-b305-2df7afe3f61b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.161990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.162773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.163073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.163349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.164524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.166053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.167460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 37/82] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:38.167648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 46/83] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:38.168408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.172747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.191273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.209935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.268989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff400d29-1875-41d1-8f55-617dfb705024 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.275045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d75b3-7a17-4e23-bf2e-70f8a95e1d2f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.302170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.302944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.303234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.303506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.308884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.309543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.309860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.310146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.311074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=e1cd5a9e0bd44d41a453c971e87604ce) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:38.311389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.313113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.313465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:38.318826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 38/84] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/role_assignments?user.id=e1cd5a9e0bd44d41a453c971e87604ce&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:38.319632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:38.321104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:38.322541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:38.323313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 47/85] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:38.326681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.424157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.447125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.447666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97093a24-bfda-4927-9758-4ee07ff86152 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.450279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1fcb-f368-4b58-91c6-defef91c7453 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.486680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.487358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.487653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.487935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.488694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.489367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.490218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.490757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.491242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.491737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.493229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.494980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.496918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 39/86] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:38.498066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.521565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 48/87] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:42:38 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:38.522835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.628495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05e4d9-bd4d-492a-a849-4b22a52c5086 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.653165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832f187-937a-4f82-ac26-399180ed2b30 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.667475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.668371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.668660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.669047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.670464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.671977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.674309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 40/88] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:38.674954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.699004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.699705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.700062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.700418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.701203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:38.701699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.703192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.705882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.718744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.719856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 49/89] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:38.720821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.791580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8237b2-1769-40bb-b576-fc426c5c722c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.834290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.834958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.836249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.836249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.841290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871216-6313-4c8d-84aa-f6c25f9bd31b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:38.887721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:38.888386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:38.888670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:38.889218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:38.889820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=8ac41a57acdf4a3aa3f15e8d08769048) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:38.890138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.891623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.903719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 50/90] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/role_assignments?user.id=8ac41a57acdf4a3aa3f15e8d08769048&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:38.904674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:38.927536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:38.929134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:38.972665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:38.991228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:39.038017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08742138-cb47-4bc8-b886-7606559144c4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:39.052017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 41/91] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:39.058483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:39.078833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:39.080312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:39.080802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:39.081283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:39.083030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:39.084778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:39.087099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 51/92] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:38 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:39.092959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:39.172885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57637a-558b-43f3-aae0-115f435a48cf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:39.206911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa521-c0c9-41b0-85c7-48e4505c6f52 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:39.210683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:39.210849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:39.211206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:39.211541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:39.212924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:39.214529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:39.216531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 42/93] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:39 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:39.222257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:39.226266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:39.249269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:39.263876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:39.264855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:39.265364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:39.265869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:39.333132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0eae2-139a-415f-8d30-9d8dc96873c1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:39.375046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:39.376412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:39.376704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:39.376986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:39.378096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] RBAC: Adding query filter params (role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=e1cd5a9e0bd44d41a453c971e87604ce) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:39.378425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:39.379921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:39.393475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 43/94] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:39 2022] GET /identity/v3/role_assignments?user.id=e1cd5a9e0bd44d41a453c971e87604ce&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:39.394296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:39.397779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:39.553576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 52/95] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:42:39.559584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:39.630247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:39.673824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2830e69-4ab2-4327-8a0f-a23aec05ea75 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:39.711436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13784dd3-5ea9-4ace-8318-8dae3792de30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:39.712833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784dd3-5ea9-4ace-8318-8dae3792de30 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:39.713428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784dd3-5ea9-4ace-8318-8dae3792de30 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:39.713936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784dd3-5ea9-4ace-8318-8dae3792de30 None admin] PATH_INFO: `/v3/projects/8a0fd9d51a434cadb20defa1aa10d213` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:39.715318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13784dd3-5ea9-4ace-8318-8dae3792de30 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0fd9d51a434cadb20defa1aa10d213)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:39.716981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13784dd3-5ea9-4ace-8318-8dae3792de30 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:39.718926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 44/96] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:39 2022] GET /identity/v3/projects/8a0fd9d51a434cadb20defa1aa10d213 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:39.725123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:39.756229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:39.855771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4dcfe-f03c-4b0a-93f6-1177e4e8cf9d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:39.904572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b9e64-e19e-404d-b50a-df950bd5d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:39.905151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9e64-e19e-404d-b50a-df950bd5d594 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:39.905438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9e64-e19e-404d-b50a-df950bd5d594 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:39.905718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9e64-e19e-404d-b50a-df950bd5d594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:39.906583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b9e64-e19e-404d-b50a-df950bd5d594 None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=8a0fd9d51a434cadb20defa1aa10d213, user.id=e1cd5a9e0bd44d41a453c971e87604ce) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:39.906899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b9e64-e19e-404d-b50a-df950bd5d594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:39.908349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b9e64-e19e-404d-b50a-df950bd5d594 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:39.918834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 53/97] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:39 2022] GET /identity/v3/role_assignments?user.id=e1cd5a9e0bd44d41a453c971e87604ce&scope.project.id=8a0fd9d51a434cadb20defa1aa10d213&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:41.511353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1fd5-e86d-40e9-8122-19833b63d76a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:41.512252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1fd5-e86d-40e9-8122-19833b63d76a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:41.512710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1fd5-e86d-40e9-8122-19833b63d76a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:41.514597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 45/98] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:41.519563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46d56-a08d-4e0a-ba94-0a5c5282e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:41.520335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46d56-a08d-4e0a-ba94-0a5c5282e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:41.520795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46d56-a08d-4e0a-ba94-0a5c5282e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:41.544819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-eaf46d56-a08d-4e0a-ba94-0a5c5282e3d0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:41.546758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-eaf46d56-a08d-4e0a-ba94-0a5c5282e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:41.644939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 54/99] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:41.683312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1fd5-e86d-40e9-8122-19833b63d76a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:41.758391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c04960-278e-445d-b3da-ef8bf1872baa None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:41.759588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c04960-278e-445d-b3da-ef8bf1872baa None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:41.760111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c04960-278e-445d-b3da-ef8bf1872baa None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:41.761566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 55/100] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:41.766827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9347-5ef2-4ad1-a280-9fc749860546 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:41.767341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9347-5ef2-4ad1-a280-9fc749860546 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:41.767829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9347-5ef2-4ad1-a280-9fc749860546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:41.798826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-288f9347-5ef2-4ad1-a280-9fc749860546 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:41.800335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-288f9347-5ef2-4ad1-a280-9fc749860546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:41.824744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1fd5-e86d-40e9-8122-19833b63d76a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:41.830923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:41.894881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:41.896177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:41.896422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:41.896878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:41.904326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 56/101] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:41.905464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:41.910395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead231d-2770-451e-9b27-0398a56f39c7 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:41.910692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead231d-2770-451e-9b27-0398a56f39c7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:41.911882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead231d-2770-451e-9b27-0398a56f39c7 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:41.912312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 57/102] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:41.929965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:41.933384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dbd55-798f-4ae6-8bb1-6b888f841df3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:41.933677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dbd55-798f-4ae6-8bb1-6b888f841df3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:41.933990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dbd55-798f-4ae6-8bb1-6b888f841df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:41.940868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:41.942951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:41.944944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:41.946938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 46/103] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:41.955771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:41.968296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f76dbd55-798f-4ae6-8bb1-6b888f841df3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:41.969475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f76dbd55-798f-4ae6-8bb1-6b888f841df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:42.111689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819bc8-f615-4c4c-8c0c-548697f82141 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:42.127581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 58/104] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:42.128255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dbd55-798f-4ae6-8bb1-6b888f841df3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.190525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:42.191221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.191517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.191797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.192554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:42.192868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:42.194305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:42.213664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 47/105] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:42.214860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.290486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:42.331984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dbd55-798f-4ae6-8bb1-6b888f841df3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:42.335637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:42.408758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d677-4558-4f39-9ce8-8730efb7957c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:42.419679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:42.420678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.421131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.421546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.432569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:42.440507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:42.441574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:42.442567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:42.444539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 59/106] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:42.445562 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.448813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d305ac-bfe9-4411-9cbf-4dc27094fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:42.450922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d305ac-bfe9-4411-9cbf-4dc27094fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.451329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d305ac-bfe9-4411-9cbf-4dc27094fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.451721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d305ac-bfe9-4411-9cbf-4dc27094fe7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.453053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d305ac-bfe9-4411-9cbf-4dc27094fe7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:42.454665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d305ac-bfe9-4411-9cbf-4dc27094fe7c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:42.460735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 48/107] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:42.460735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b4db7-9fbb-47bd-beb3-425041ecd2b7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.460735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b4db7-9fbb-47bd-beb3-425041ecd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.460735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b4db7-9fbb-47bd-beb3-425041ecd2b7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.460735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 49/108] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:42.460735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b4db7-9fbb-47bd-beb3-425041ecd2b7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.576794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e83d7-fc9c-41ed-8cea-30b0c524f43c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:42.585737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b4db7-9fbb-47bd-beb3-425041ecd2b7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:42.621023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:42.627852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:42.629135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.629642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.630159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.631657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:42.633053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de65c5-6ea2-43fc-8a49-07325fa68e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:42.633793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:42.633895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de65c5-6ea2-43fc-8a49-07325fa68e9e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.634122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de65c5-6ea2-43fc-8a49-07325fa68e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.634396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de65c5-6ea2-43fc-8a49-07325fa68e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.635155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de65c5-6ea2-43fc-8a49-07325fa68e9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:42.635469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de65c5-6ea2-43fc-8a49-07325fa68e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:42.641158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de65c5-6ea2-43fc-8a49-07325fa68e9e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:42.641468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 60/109] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:42 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:42.642600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.647907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 50/110] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:42.648491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03014-9a86-4b57-a9ae-a3032ab2672e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.648795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03014-9a86-4b57-a9ae-a3032ab2672e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.649083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03014-9a86-4b57-a9ae-a3032ab2672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.661088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:42.668894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bbc03014-9a86-4b57-a9ae-a3032ab2672e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:42.670396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bbc03014-9a86-4b57-a9ae-a3032ab2672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:42.744706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 51/111] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:42.745630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03014-9a86-4b57-a9ae-a3032ab2672e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.751423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fcbb5-5860-4aaf-88c1-c0021e89ebae None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:42.791065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:42.792141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.792748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.793243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.794233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:42.796137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:42.833236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 61/112] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:42:42 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:42.834684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.852483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03014-9a86-4b57-a9ae-a3032ab2672e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:42.874462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:42.891781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:42.892666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:42.892958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:42.893240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:42.894491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:42.897325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:42.898035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 52/113] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:42 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:42.898847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:42.968015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:43.015896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd50e3a-ddc1-44c0-9ea4-54dcfef877c5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.027088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84802280-236c-4096-b6e3-2b88c4e797c8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.056337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.057615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.058153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.058630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] PATH_INFO: `/v3/users/9f2ffbf0973e478694f5e8b442604486` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.065117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1f1ca-0245-4b4d-9764-66fb5f54d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.065994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1f1ca-0245-4b4d-9764-66fb5f54d933 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.066286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1f1ca-0245-4b4d-9764-66fb5f54d933 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.066569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1f1ca-0245-4b4d-9764-66fb5f54d933 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.078202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] RBAC: Authorizing `identity:get_user(user_id=9f2ffbf0973e478694f5e8b442604486)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:43.078622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1f1ca-0245-4b4d-9764-66fb5f54d933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:43.080317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:43.082614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 62/114] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:42 2022] GET /identity/v3/users/9f2ffbf0973e478694f5e8b442604486 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:43.083684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-76c1f1ca-0245-4b4d-9764-66fb5f54d933 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:43.088758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:43.089616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 53/115] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:43.094751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753c319-62e3-4544-9d01-47ac30f52468 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.095449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753c319-62e3-4544-9d01-47ac30f52468 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.095449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753c319-62e3-4544-9d01-47ac30f52468 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.095449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 54/116] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:43.095449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753c319-62e3-4544-9d01-47ac30f52468 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.152658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:43.220724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753c319-62e3-4544-9d01-47ac30f52468 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.221069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36dd0-74f7-4bcf-ae1b-d0f9ed3e8ada None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.246027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:43.258338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a010e-a619-4703-ba97-c3326cf32afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.259289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a010e-a619-4703-ba97-c3326cf32afb None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.259616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a010e-a619-4703-ba97-c3326cf32afb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.259845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a010e-a619-4703-ba97-c3326cf32afb None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/e1cd5a9e0bd44d41a453c971e87604ce/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.261957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a010e-a619-4703-ba97-c3326cf32afb None admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb9343ccb7487ea8149ed0520905cb, user_id=e1cd5a9e0bd44d41a453c971e87604ce, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:43.263416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a010e-a619-4703-ba97-c3326cf32afb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:43.263761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.264701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.265191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.265809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.280487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 63/117] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:42:43 2022] PUT /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/e1cd5a9e0bd44d41a453c971e87604ce/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:42:43.287056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf994-10cb-4a41-b3b5-0cd1e097bdac None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.287056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf994-10cb-4a41-b3b5-0cd1e097bdac None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.287056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf994-10cb-4a41-b3b5-0cd1e097bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.326957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d67cf994-10cb-4a41-b3b5-0cd1e097bdac None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:43.328205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d67cf994-10cb-4a41-b3b5-0cd1e097bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:43.367209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:43.369851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:43.427848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 64/118] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:43.429219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cf994-10cb-4a41-b3b5-0cd1e097bdac None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.434134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:43.522887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 55/119] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:43.523785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.561023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cf994-10cb-4a41-b3b5-0cd1e097bdac None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.576626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:43.612023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3720ad-3690-4e96-a917-48b4c4980cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.612716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3720ad-3690-4e96-a917-48b4c4980cae None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.613009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3720ad-3690-4e96-a917-48b4c4980cae None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.613294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3720ad-3690-4e96-a917-48b4c4980cae None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.614102 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3720ad-3690-4e96-a917-48b4c4980cae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:43.614394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3720ad-3690-4e96-a917-48b4c4980cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:43.615800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3720ad-3690-4e96-a917-48b4c4980cae None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:43.624765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 65/120] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:43.630630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac491-1edb-432a-8b43-d86fd31c24dd None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.630937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac491-1edb-432a-8b43-d86fd31c24dd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.631229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac491-1edb-432a-8b43-d86fd31c24dd None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.632716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 66/121] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:43.633294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac491-1edb-432a-8b43-d86fd31c24dd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.645876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac25d-61be-4174-aec0-e1d9160bcf09 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.693279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.694384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.694757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.695117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.707481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:43.718593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:43.719528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 56/122] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:42:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:43.720357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.735312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:43.758401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac491-1edb-432a-8b43-d86fd31c24dd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.796112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c1a75-339c-4f69-91b3-c4ad6205d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.797357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1a75-339c-4f69-91b3-c4ad6205d682 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.797922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1a75-339c-4f69-91b3-c4ad6205d682 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.798472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1a75-339c-4f69-91b3-c4ad6205d682 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.800020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c1a75-339c-4f69-91b3-c4ad6205d682 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:43.801781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c1a75-339c-4f69-91b3-c4ad6205d682 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:43.803942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 67/123] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:43 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:43.805416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32637e-5d63-45f6-be53-fcfe4619d066 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.806499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32637e-5d63-45f6-be53-fcfe4619d066 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.806994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32637e-5d63-45f6-be53-fcfe4619d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.825412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8f32637e-5d63-45f6-be53-fcfe4619d066 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:43.826963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8f32637e-5d63-45f6-be53-fcfe4619d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:43.841562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a02f1-b890-467d-8fa0-7dd65a8e78e6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:43.866734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:43.880287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:43.881464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:43.881963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:43.882389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] PATH_INFO: `/v3/users/8ac41a57acdf4a3aa3f15e8d08769048` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:43.884320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] RBAC: Authorizing `identity:get_user(user_id=8ac41a57acdf4a3aa3f15e8d08769048)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:43.886175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:43.888014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 57/124] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:43 2022] GET /identity/v3/users/8ac41a57acdf4a3aa3f15e8d08769048 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:43.889184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.904030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 68/125] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:43.909823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32637e-5d63-45f6-be53-fcfe4619d066 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:43.997679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:44.025288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32637e-5d63-45f6-be53-fcfe4619d066 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.029228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8811abc-a861-4717-bd86-100b258b6aad None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.062356 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.063049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.063478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.063767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.064591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] RBAC: Adding query filter params (role.id=3a1eebbb86f4445695d0ba65b3450de6, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=9f2ffbf0973e478694f5e8b442604486) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:44.064928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.066514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.072369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 69/126] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:43 2022] GET /identity/v3/role_assignments?user.id=9f2ffbf0973e478694f5e8b442604486&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=3a1eebbb86f4445695d0ba65b3450de6 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:44.073167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.073398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.074399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.074901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.075393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.077736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:44.078362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.081223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.099396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 58/127] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:42:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:44.100051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.119140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:44.247479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26080e-ebbb-4a82-98fc-fc3ea0c63cdf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.295312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68c9a-fb0b-4160-8eb0-37c8b1d0ed40 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.301426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.302331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.302622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.302908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.304132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.306659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.308343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 70/128] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:44 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:44.309358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.366990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.368800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.369299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.370312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.377630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:44.403302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:44.411113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:44.412130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:44.412905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 59/129] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:44.413548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.519932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a9071-7f6b-4bb3-8ee8-54423bc6f7a7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.523829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb59a2b-f3fa-4012-854d-a87866857691 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.530774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:44.559304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.560671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.561183 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.561730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/8ac41a57acdf4a3aa3f15e8d08769048/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.564405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb9343ccb7487ea8149ed0520905cb, user_id=8ac41a57acdf4a3aa3f15e8d08769048, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.565916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.583646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 60/130] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:42:44 2022] PUT /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/8ac41a57acdf4a3aa3f15e8d08769048/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:42:44.584483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.619536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.620354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.620619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.620905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.626569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.628091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.630267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 71/131] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:44 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:44.635599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.650731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:44.702691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b51034-f5a9-48c1-8a8c-b50f3488fcdd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.742049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.743610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.744150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.744577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.745546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:44.746031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.747820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.757491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 61/132] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:44.763815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.809023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4baf8-43d1-4bca-8074-e6fc25fd47e1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.871925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.872728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.873013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.873295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.878216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bba98-83ba-4f80-a590-fafe6e24fb9d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:44.878581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.880121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.882281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 72/133] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:44 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:44.888679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:44.901174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:44.922366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:44.923544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:44.923978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:44.924403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:44.925935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:44.928062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:44.930003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 62/134] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:44 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:44.939346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:45.009128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:45.066208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c68616-f5dd-4105-9bd7-e4971330ba8c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:45.074125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039836-19ee-4d60-bd97-89f5df079f46 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:45.105793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:45.106948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:45.107385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:45.107900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] PATH_INFO: `/v3/projects/8a0fd9d51a434cadb20defa1aa10d213` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:45.109425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] RBAC: Authorizing `identity:get_project(project_id=8a0fd9d51a434cadb20defa1aa10d213)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:45.111205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:45.113597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 63/135] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:44 2022] GET /identity/v3/projects/8a0fd9d51a434cadb20defa1aa10d213 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:45.117611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766463a-c6b5-40e4-aae7-3f5ca3f52a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:45.118768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766463a-c6b5-40e4-aae7-3f5ca3f52a00 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:45.119075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766463a-c6b5-40e4-aae7-3f5ca3f52a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:45.119353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766463a-c6b5-40e4-aae7-3f5ca3f52a00 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/e1cd5a9e0bd44d41a453c971e87604ce/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:45.120282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:45.121800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766463a-c6b5-40e4-aae7-3f5ca3f52a00 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb9343ccb7487ea8149ed0520905cb, user_id=e1cd5a9e0bd44d41a453c971e87604ce, role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:45.123735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766463a-c6b5-40e4-aae7-3f5ca3f52a00 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:45.140072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 73/136] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:42:44 2022] PUT /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/e1cd5a9e0bd44d41a453c971e87604ce/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:42:45.187748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:45.239003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637cbab-a051-4d53-9096-8fe8dcbadbaa None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:45.279376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b6b76-d618-491a-a575-65c954e42100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:45.280384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6b76-d618-491a-a575-65c954e42100 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:45.280681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6b76-d618-491a-a575-65c954e42100 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:45.281016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6b76-d618-491a-a575-65c954e42100 None admin] PATH_INFO: `/v3/projects/8a0fd9d51a434cadb20defa1aa10d213/users/e1cd5a9e0bd44d41a453c971e87604ce/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:45.283101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b6b76-d618-491a-a575-65c954e42100 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a0fd9d51a434cadb20defa1aa10d213, user_id=e1cd5a9e0bd44d41a453c971e87604ce, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:45.284603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b6b76-d618-491a-a575-65c954e42100 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:45.300714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 64/137] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:42:45 2022] PUT /identity/v3/projects/8a0fd9d51a434cadb20defa1aa10d213/users/e1cd5a9e0bd44d41a453c971e87604ce/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:42:45.532359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054bf9-d4b9-41d3-b5a7-6f307194d095 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:45.532882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054bf9-d4b9-41d3-b5a7-6f307194d095 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:45.533311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054bf9-d4b9-41d3-b5a7-6f307194d095 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:45.534900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 74/138] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:45.540420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e655f6-1146-48af-8eab-230a403dbbc2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:45.540717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e655f6-1146-48af-8eab-230a403dbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:45.541009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e655f6-1146-48af-8eab-230a403dbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:45.562805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-67e655f6-1146-48af-8eab-230a403dbbc2 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:45.564028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-67e655f6-1146-48af-8eab-230a403dbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:45.644340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 65/139] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:45.689157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054bf9-d4b9-41d3-b5a7-6f307194d095 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:45.813853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:45.820293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054bf9-d4b9-41d3-b5a7-6f307194d095 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:45.867556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc43a0-34ee-431b-a83e-6917a3191d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:45.868388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc43a0-34ee-431b-a83e-6917a3191d18 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:45.868678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc43a0-34ee-431b-a83e-6917a3191d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:45.868957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc43a0-34ee-431b-a83e-6917a3191d18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:45.870196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc43a0-34ee-431b-a83e-6917a3191d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:45.871668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc43a0-34ee-431b-a83e-6917a3191d18 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:45.873497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 75/140] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:45.879334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e655f6-1146-48af-8eab-230a403dbbc2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:45.939145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:46.013563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e655f6-1146-48af-8eab-230a403dbbc2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:46.066456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f3ad-67ca-48a1-b4a1-2fb0ee231cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:46.067147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f3ad-67ca-48a1-b4a1-2fb0ee231cbc None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:46.067442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f3ad-67ca-48a1-b4a1-2fb0ee231cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:46.067721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f3ad-67ca-48a1-b4a1-2fb0ee231cbc None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:46.068438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f3ad-67ca-48a1-b4a1-2fb0ee231cbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:46.070021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f3ad-67ca-48a1-b4a1-2fb0ee231cbc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:46.094546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 66/141] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:42:45 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:46.744299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd740541-5be4-494f-8d80-d062b31ac2ce None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:46.744809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd740541-5be4-494f-8d80-d062b31ac2ce None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:46.744905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd740541-5be4-494f-8d80-d062b31ac2ce None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:46.746572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 76/142] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:46.752684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4b68b-b506-4873-b371-d563d5c173db None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:46.752982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4b68b-b506-4873-b371-d563d5c173db None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:46.753470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4b68b-b506-4873-b371-d563d5c173db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:46.778944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-45e4b68b-b506-4873-b371-d563d5c173db None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:46.780149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-45e4b68b-b506-4873-b371-d563d5c173db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:46.860431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 67/143] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:46.898620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd740541-5be4-494f-8d80-d062b31ac2ce None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:47.039554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd740541-5be4-494f-8d80-d062b31ac2ce None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:47.079913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:47.080716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:47.081000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:47.081276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:47.094922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:47.103341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:47.104248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:47.105001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 77/144] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:47.111627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4b68b-b506-4873-b371-d563d5c173db None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:47.148721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:47.236502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4b68b-b506-4873-b371-d563d5c173db None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:47.280577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:47.281274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:47.281554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:47.281856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:47.282619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:47.282926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:47.284351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:47.297939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 68/145] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:47.300082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:47.329676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:47.410952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc4eb5-9c58-43fd-9108-2a1532baa694 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:47.451789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb36f91-93cd-4135-acde-eaa65d6eea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:47.452668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36f91-93cd-4135-acde-eaa65d6eea9a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:47.452949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36f91-93cd-4135-acde-eaa65d6eea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:47.453276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36f91-93cd-4135-acde-eaa65d6eea9a None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:47.454488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb36f91-93cd-4135-acde-eaa65d6eea9a None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:47.455945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb36f91-93cd-4135-acde-eaa65d6eea9a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:47.457578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 78/146] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:47 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:47.463808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:47.578798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:47.588571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74507d0-4a81-45bf-88a3-baeb6650f503 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:47.623627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:47.624290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:47.624580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:47.624857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:47.705268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:47.706787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:47.720724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e91059-a56a-455e-8934-6bbfeaa65d9e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:47.721022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e91059-a56a-455e-8934-6bbfeaa65d9e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:47.721288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e91059-a56a-455e-8934-6bbfeaa65d9e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:47.722834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 79/147] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:42:47.729422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33888dff-3a8d-4368-9b9f-52bd7e69b61c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:47.729779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33888dff-3a8d-4368-9b9f-52bd7e69b61c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:47.730070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33888dff-3a8d-4368-9b9f-52bd7e69b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:47.753293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-33888dff-3a8d-4368-9b9f-52bd7e69b61c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:47.755745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-33888dff-3a8d-4368-9b9f-52bd7e69b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:47.862904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:47.874574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 69/148] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:47.882895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:47.888007 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 80/149] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:47.930913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33888dff-3a8d-4368-9b9f-52bd7e69b61c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:47.986119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:48.079877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945361-4474-44b9-bd31-6abd4b44f613 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:48.108472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33888dff-3a8d-4368-9b9f-52bd7e69b61c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:48.170592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:48.170775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:48.171393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.171677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.171953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:48.172577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.173012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.173429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:48.178537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:48.180020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:48.182717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 70/150] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:47 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:48.188925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:48.199490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:48.208363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:48.209412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:48.210383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:48.212764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 81/151] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:48.218424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:48.340040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:48.391390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:48.428988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79bf78-c710-4602-98c3-b1c0eeec4019 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:48.448348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8bcc2-4a25-477e-bf48-93b2676e4b94 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:48.505487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7eb76-9b58-47bf-b5d7-d36639aa5e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:48.506198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7eb76-9b58-47bf-b5d7-d36639aa5e45 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.506487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7eb76-9b58-47bf-b5d7-d36639aa5e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.507083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7eb76-9b58-47bf-b5d7-d36639aa5e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:48.508114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7eb76-9b58-47bf-b5d7-d36639aa5e45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:48.508444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7eb76-9b58-47bf-b5d7-d36639aa5e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:48.509910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7eb76-9b58-47bf-b5d7-d36639aa5e45 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:48.519792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3945b-ce55-4835-b925-407c99d9f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:48.520686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3945b-ce55-4835-b925-407c99d9f4bc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.521386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3945b-ce55-4835-b925-407c99d9f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.521875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3945b-ce55-4835-b925-407c99d9f4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:48.523344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3945b-ce55-4835-b925-407c99d9f4bc None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=e1cd5a9e0bd44d41a453c971e87604ce) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:48.523825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3945b-ce55-4835-b925-407c99d9f4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:48.526016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3945b-ce55-4835-b925-407c99d9f4bc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:48.533546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 82/152] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:48.533546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06797c-59d1-4e54-918c-d50f1291c613 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.533546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06797c-59d1-4e54-918c-d50f1291c613 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.533546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06797c-59d1-4e54-918c-d50f1291c613 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:48.533546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 83/153] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:48.534724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06797c-59d1-4e54-918c-d50f1291c613 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:48.544554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 71/154] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:48 2022] GET /identity/v3/role_assignments?user.id=e1cd5a9e0bd44d41a453c971e87604ce&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:48.546918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94ffd-48de-453c-8051-8e059a9362e7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.547360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94ffd-48de-453c-8051-8e059a9362e7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.547812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94ffd-48de-453c-8051-8e059a9362e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:48.579998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0bc94ffd-48de-453c-8051-8e059a9362e7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:48.581477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0bc94ffd-48de-453c-8051-8e059a9362e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:48.711026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 72/155] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:48.758168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc94ffd-48de-453c-8051-8e059a9362e7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:48.782154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06797c-59d1-4e54-918c-d50f1291c613 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:48.879028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:48.906504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:48.907402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.907687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.907968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] PATH_INFO: `/v3/users/9f2ffbf0973e478694f5e8b442604486` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:48.909233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] RBAC: Authorizing `identity:get_user(user_id=9f2ffbf0973e478694f5e8b442604486)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:48.910711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:48.912664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 84/156] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:48 2022] GET /identity/v3/users/9f2ffbf0973e478694f5e8b442604486 => generated 289 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:48.930466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:48.939877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc94ffd-48de-453c-8051-8e059a9362e7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:48.961711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:48.996320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:48.997401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:48.997699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:48.998019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.015365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:49.029563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:49.030789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:49.031763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 73/157] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:42:49.041805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:49.144807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a957981-7abf-4ed1-a923-17100ecfff08 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:49.213315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9718fa-3eea-4e69-8618-6876bc4d266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:49.214429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9718fa-3eea-4e69-8618-6876bc4d266e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.214874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9718fa-3eea-4e69-8618-6876bc4d266e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.215302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9718fa-3eea-4e69-8618-6876bc4d266e None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.216732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9718fa-3eea-4e69-8618-6876bc4d266e None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:49.217579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb741a-7e50-4ac7-9848-c1122897bd56 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:49.218994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9718fa-3eea-4e69-8618-6876bc4d266e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:49.221203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 85/158] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:48 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:49.222640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920accd-a99a-4f96-a42e-ac906a155e87 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.223143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920accd-a99a-4f96-a42e-ac906a155e87 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.223638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920accd-a99a-4f96-a42e-ac906a155e87 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.231272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 86/159] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:49.232395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920accd-a99a-4f96-a42e-ac906a155e87 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:49.254123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:49.277472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fa144-eb5b-4510-9351-4697bccb4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:49.278575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa144-eb5b-4510-9351-4697bccb4b86 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.279792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa144-eb5b-4510-9351-4697bccb4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.280914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa144-eb5b-4510-9351-4697bccb4b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.283025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fa144-eb5b-4510-9351-4697bccb4b86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:49.284278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fa144-eb5b-4510-9351-4697bccb4b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:49.286102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fa144-eb5b-4510-9351-4697bccb4b86 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:49.302159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 74/160] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:49.311230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40218e9-7849-4623-8066-cbafebae3e77 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.312640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40218e9-7849-4623-8066-cbafebae3e77 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.313216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40218e9-7849-4623-8066-cbafebae3e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.342829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b40218e9-7849-4623-8066-cbafebae3e77 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:49.344047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b40218e9-7849-4623-8066-cbafebae3e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:49.393800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:49.414124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920accd-a99a-4f96-a42e-ac906a155e87 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:49.450151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:49.451175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.451537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.451885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/9f2ffbf0973e478694f5e8b442604486/roles/3a1eebbb86f4445695d0ba65b3450de6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.454113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb9343ccb7487ea8149ed0520905cb, user_id=9f2ffbf0973e478694f5e8b442604486, role_id=3a1eebbb86f4445695d0ba65b3450de6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:49.455702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:49.471697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 87/161] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:42:49 2022] PUT /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/users/9f2ffbf0973e478694f5e8b442604486/roles/3a1eebbb86f4445695d0ba65b3450de6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:42:49.472524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 75/162] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:49.473077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:49.517470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61a45-f7a5-4f0b-b0bc-3ebc72f1ca6a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.518126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61a45-f7a5-4f0b-b0bc-3ebc72f1ca6a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.518618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61a45-f7a5-4f0b-b0bc-3ebc72f1ca6a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.520201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 76/163] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:49.521399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb61a45-f7a5-4f0b-b0bc-3ebc72f1ca6a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:49.614418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108f1a-d8dc-4d13-8262-df08315a5c82 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:49.652081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d430050-3d60-4405-8bec-f244321a2bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:49.652985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430050-3d60-4405-8bec-f244321a2bef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.653267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430050-3d60-4405-8bec-f244321a2bef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.653543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430050-3d60-4405-8bec-f244321a2bef None admin] PATH_INFO: `/v3/users/8ac41a57acdf4a3aa3f15e8d08769048` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.655029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d430050-3d60-4405-8bec-f244321a2bef None admin] RBAC: Authorizing `identity:get_user(user_id=8ac41a57acdf4a3aa3f15e8d08769048)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:49.656560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d430050-3d60-4405-8bec-f244321a2bef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:49.661792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 88/164] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:49 2022] GET /identity/v3/users/8ac41a57acdf4a3aa3f15e8d08769048 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:49.661792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9d82e-9020-43f4-9eaf-65ccd99c9ce4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.661792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9d82e-9020-43f4-9eaf-65ccd99c9ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.661792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9d82e-9020-43f4-9eaf-65ccd99c9ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.682357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-71e9d82e-9020-43f4-9eaf-65ccd99c9ce4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:49.683785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-71e9d82e-9020-43f4-9eaf-65ccd99c9ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:49.700641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:49.758010 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb61a45-f7a5-4f0b-b0bc-3ebc72f1ca6a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:49.773018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:49.842485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:49.843413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:49.843707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:49.843990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:49.845859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 89/165] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:49.846790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9d82e-9020-43f4-9eaf-65ccd99c9ce4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:49.870372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:49.878774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:49.879803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:49.880730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 77/166] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:42:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:49.882168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:50.056240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9d82e-9020-43f4-9eaf-65ccd99c9ce4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:50.117298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2aee60-bce6-491d-95aa-0d497f270d9f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:50.150098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:50.151111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:50.151749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:50.152909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:50.185596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:50.212288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:50.213517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:50.219093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:50.220347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:50.243919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:50.252626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:50.253480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:50.254310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:50.262191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 78/167] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:50.263359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:50.272854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:50.275911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:50.311928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:50.392653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 90/168] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:50.393072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:50.432428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebfe65-1f37-425b-b164-6e5fcf76e38b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:50.447403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:50.481303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:50.483134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:50.486733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:50.488198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:50.489171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:50.491354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:50.493000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:50.510833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 79/169] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:50.512127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:50.530998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049de0-35fe-4bc5-8947-5eee0b45252d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:50.594293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:50.595361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:50.595888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:50.596363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:50.597325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:50.598726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:50.600323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:50.617301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 91/170] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:50.619316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:50.654235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:50.675185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f05b3-4d29-40a0-b02e-95ccc9f714ae None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:50.739875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:50.740739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:50.741021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:50.741542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:50.744141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:50.745605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:50.747528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 80/171] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:50 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:50.748124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:50.814171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e75bc-6cfe-4956-ad9f-c4c5ec53e398 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:50.820106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:50.877363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4acd1-9645-4ab6-a4e1-5ccb5f612238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:50.878185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4acd1-9645-4ab6-a4e1-5ccb5f612238 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:50.878470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4acd1-9645-4ab6-a4e1-5ccb5f612238 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:50.878910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4acd1-9645-4ab6-a4e1-5ccb5f612238 None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:50.880248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4acd1-9645-4ab6-a4e1-5ccb5f612238 None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:50.881702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4acd1-9645-4ab6-a4e1-5ccb5f612238 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:50.883591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 92/172] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:50 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:50.884685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34d12-d2b1-4e28-b0d1-32c26e5fa7de None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:50.884978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34d12-d2b1-4e28-b0d1-32c26e5fa7de None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:50.885258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34d12-d2b1-4e28-b0d1-32c26e5fa7de None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:50.886520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 93/173] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:50.887418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b34d12-d2b1-4e28-b0d1-32c26e5fa7de None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:50.960020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd648-642c-44c6-9a1b-f04089db6d36 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:51.032756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3c47c-10f9-45b1-8672-61a9cb1b37cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:51.033665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c47c-10f9-45b1-8672-61a9cb1b37cc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.033977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c47c-10f9-45b1-8672-61a9cb1b37cc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.035183 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c47c-10f9-45b1-8672-61a9cb1b37cc None admin] PATH_INFO: `/v3/users/e1cd5a9e0bd44d41a453c971e87604ce` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.038048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3c47c-10f9-45b1-8672-61a9cb1b37cc None admin] RBAC: Authorizing `identity:get_user(user_id=e1cd5a9e0bd44d41a453c971e87604ce)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:51.041738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3c47c-10f9-45b1-8672-61a9cb1b37cc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:51.043769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 81/174] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:50 2022] GET /identity/v3/users/e1cd5a9e0bd44d41a453c971e87604ce => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:51.046716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21128095-27dd-42ac-8d0d-94515e1064d9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.047009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21128095-27dd-42ac-8d0d-94515e1064d9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.047291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21128095-27dd-42ac-8d0d-94515e1064d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.061337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b34d12-d2b1-4e28-b0d1-32c26e5fa7de None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:51.084993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-21128095-27dd-42ac-8d0d-94515e1064d9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:51.086581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21128095-27dd-42ac-8d0d-94515e1064d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:51.130950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:51.144466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:51.145461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.146853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.147148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.147996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=8ac41a57acdf4a3aa3f15e8d08769048) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:51.148313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:51.150378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:51.169210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 94/175] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:50 2022] GET /identity/v3/role_assignments?user.id=8ac41a57acdf4a3aa3f15e8d08769048&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:51.170069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:51.226763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 82/176] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:51.227796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21128095-27dd-42ac-8d0d-94515e1064d9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:51.244281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:51.429114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1baf-ec3b-4319-b2f7-963dea67a1a4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:51.451737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21128095-27dd-42ac-8d0d-94515e1064d9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:51.468608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:51.470241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.470743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.471249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.502402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156df46a-88f0-4453-9269-d4d4b0611439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:51.503416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156df46a-88f0-4453-9269-d4d4b0611439 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.503924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156df46a-88f0-4453-9269-d4d4b0611439 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.504306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156df46a-88f0-4453-9269-d4d4b0611439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.535545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:51.559903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:51.561416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:51.585636 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156df46a-88f0-4453-9269-d4d4b0611439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:51.587966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156df46a-88f0-4453-9269-d4d4b0611439 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:51.614538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:51.679503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 95/177] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:51.681161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:51.698883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 83/178] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:51.700449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e5b3-412b-4384-a8b6-96a83c1a28e1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.700947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e5b3-412b-4384-a8b6-96a83c1a28e1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.701401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e5b3-412b-4384-a8b6-96a83c1a28e1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.706845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 84/179] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:51.707626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86eb6e-8c2c-4f86-98ff-73370467eedb None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.707920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86eb6e-8c2c-4f86-98ff-73370467eedb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.708201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86eb6e-8c2c-4f86-98ff-73370467eedb None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.710060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 85/180] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:51.714453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86eb6e-8c2c-4f86-98ff-73370467eedb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:51.776048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:51.794415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541802a-ef02-455c-acc1-b5a25f2af5f6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:51.824648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86eb6e-8c2c-4f86-98ff-73370467eedb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:51.829664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:51.830495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.830781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.831060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.834388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:51.843373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:51.850983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:51.851840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:51.853347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 96/181] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:51.858168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:51.863849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b72b51-2cbd-421f-b893-d2d9a3a0717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:51.864713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b72b51-2cbd-421f-b893-d2d9a3a0717e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.864996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b72b51-2cbd-421f-b893-d2d9a3a0717e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.865270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b72b51-2cbd-421f-b893-d2d9a3a0717e None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.866446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b72b51-2cbd-421f-b893-d2d9a3a0717e None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:51.867952 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b72b51-2cbd-421f-b893-d2d9a3a0717e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:51.869642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 86/182] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:51 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:51.870815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da878-0b3d-45a0-a3da-00430ed1f64f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.871101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da878-0b3d-45a0-a3da-00430ed1f64f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.871380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da878-0b3d-45a0-a3da-00430ed1f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:51.889827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d23da878-0b3d-45a0-a3da-00430ed1f64f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:51.890979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d23da878-0b3d-45a0-a3da-00430ed1f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:51.973887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 87/183] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:51.975336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501d85-3f59-454e-a5e0-1e668873815f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:51.975796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ca78c-466f-4c50-bd55-2bf9fa21641c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:51.975796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ca78c-466f-4c50-bd55-2bf9fa21641c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:51.976052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ca78c-466f-4c50-bd55-2bf9fa21641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.000930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0c5ca78c-466f-4c50-bd55-2bf9fa21641c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:52.002149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0c5ca78c-466f-4c50-bd55-2bf9fa21641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:52.020187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.021309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.021592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.021895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] PATH_INFO: `/v3/projects/8a0fd9d51a434cadb20defa1aa10d213` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.023065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0fd9d51a434cadb20defa1aa10d213)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.025132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.031744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 97/184] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:51 2022] GET /identity/v3/projects/8a0fd9d51a434cadb20defa1aa10d213 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:52.031744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.058370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.089772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 88/185] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:52.089772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ca78c-466f-4c50-bd55-2bf9fa21641c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.099123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.142229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5065c02-6f20-4fc1-9215-010439e3c9d2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.178061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.178764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.179045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.179322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.180059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:52.180877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.182277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.195480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 98/186] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:52.197350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.206661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ca78c-466f-4c50-bd55-2bf9fa21641c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.240932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.241556 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.241818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.242107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.243504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] RBAC: Adding query filter params (role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=e1cd5a9e0bd44d41a453c971e87604ce) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:52.243820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.245278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.261776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 89/187] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/role_assignments?user.id=e1cd5a9e0bd44d41a453c971e87604ce&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:52.261776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.316600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.327024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b6ca-58cd-49bd-b283-409ee82eaf76 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.368578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.379350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.380205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.380492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.380774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.390634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879ce5-d854-4f4f-af4f-d33455d27423 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.392633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:52.401979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:52.402845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:52.403613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 99/188] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:52.404792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.441515 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.442614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.443280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.444640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.445784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=8a0fd9d51a434cadb20defa1aa10d213, user.id=e1cd5a9e0bd44d41a453c971e87604ce) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:52.446367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.448066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.456690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 90/189] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/role_assignments?user.id=e1cd5a9e0bd44d41a453c971e87604ce&scope.project.id=8a0fd9d51a434cadb20defa1aa10d213&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:52.458335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.525376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe16ac-5559-4973-8284-5f45e22c0326 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.569556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b877-68ab-4537-b065-42843625e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.570409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b877-68ab-4537-b065-42843625e705 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.570690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b877-68ab-4537-b065-42843625e705 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.570996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b877-68ab-4537-b065-42843625e705 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.572260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831b877-68ab-4537-b065-42843625e705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.573831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831b877-68ab-4537-b065-42843625e705 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.575658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 100/190] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:52.576289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b877-68ab-4537-b065-42843625e705 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.607392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47857d12-09be-40ac-8d01-906067fefd07 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.623182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.644788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.652455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a07cb-d86f-4d32-a467-4db9efce35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.653429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a07cb-d86f-4d32-a467-4db9efce35d3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.653709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a07cb-d86f-4d32-a467-4db9efce35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.654014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a07cb-d86f-4d32-a467-4db9efce35d3 None admin] PATH_INFO: `/v3/users/ab2c4801c1f44c8c901133b58d66f8f3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.670252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a07cb-d86f-4d32-a467-4db9efce35d3 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2c4801c1f44c8c901133b58d66f8f3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.671757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a07cb-d86f-4d32-a467-4db9efce35d3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.673580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 91/191] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/users/ab2c4801c1f44c8c901133b58d66f8f3 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:52.674889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1c1f-fa7b-4775-9cc1-043ca7636a98 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.675176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1c1f-fa7b-4775-9cc1-043ca7636a98 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.675451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1c1f-fa7b-4775-9cc1-043ca7636a98 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.679742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 92/192] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:52.679742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee1c1f-fa7b-4775-9cc1-043ca7636a98 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.704364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b877-68ab-4537-b065-42843625e705 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.747053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.747919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.748283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.748658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.749511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:52.749952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.751453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.760121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 101/193] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:52.761376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.787434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee1c1f-fa7b-4775-9cc1-043ca7636a98 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.820761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12201082-32db-4358-a67d-62ad93e03ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.821464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12201082-32db-4358-a67d-62ad93e03ba0 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.821763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12201082-32db-4358-a67d-62ad93e03ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.822152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12201082-32db-4358-a67d-62ad93e03ba0 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.822866 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12201082-32db-4358-a67d-62ad93e03ba0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.824317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12201082-32db-4358-a67d-62ad93e03ba0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:52.846604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 93/194] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:42:52 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:52.847831 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ac853-4101-48ce-9111-d838c29ef813 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.848123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ac853-4101-48ce-9111-d838c29ef813 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.848400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ac853-4101-48ce-9111-d838c29ef813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.861796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bdba9-621e-40cb-90de-40f38a297d9b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:52.867121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-173ac853-4101-48ce-9111-d838c29ef813 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:52.868384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-173ac853-4101-48ce-9111-d838c29ef813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:52.880255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.888555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:52.904327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:52.904997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:52.905281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:52.905561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:52.944231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 94/195] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:52.950924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ac853-4101-48ce-9111-d838c29ef813 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:52.987850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:52.989356 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.064416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ac853-4101-48ce-9111-d838c29ef813 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.098975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 102/196] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:53.099981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.115422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.118525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.118525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.118525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] PATH_INFO: `/v3/users/ab2c4801c1f44c8c901133b58d66f8f3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.119216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] RBAC: Authorizing `identity:get_user(user_id=ab2c4801c1f44c8c901133b58d66f8f3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.121023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.123683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 95/197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:52 2022] GET /identity/v3/users/ab2c4801c1f44c8c901133b58d66f8f3 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:53.123683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.127686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.152062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.234151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b8fa7-9aa3-4f96-af73-ac57aa5f93d7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.246595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f8282-96ba-4116-897c-33c595503d0f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.282466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.283372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.283654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.283929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.284920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.285812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.286104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.286376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.287678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.289142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.291494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 96/198] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:53.292344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.295263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:53.305899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:53.306805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:53.307595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:53.308804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 103/199] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:53.310255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.394932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.407396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6cc02-cefc-4ff0-9913-444651145eac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.428602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.442763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.443510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.443867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.444218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.455989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9329-279b-42fd-958d-8ba5e4665f5a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.493500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.494191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.494478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.494754 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.495706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=ab2c4801c1f44c8c901133b58d66f8f3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:53.496124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.497601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.505127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 104/200] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/role_assignments?user.id=ab2c4801c1f44c8c901133b58d66f8f3&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:53.505961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.516761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.518453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.616640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c516cd-803c-4f69-a549-502b2764b896 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.622146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.625735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 97/201] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:53.631559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.655735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.656324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.656612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.656890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.657647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:53.657992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.659401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.668818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 105/202] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:53.674858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.677853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.743413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a7049-0e99-4225-8f69-41b211c90565 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.784062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c3d00-f4ee-4219-9ab4-c24c6770f486 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.787567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.788441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.788726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.789006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.790292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.791746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.798011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 98/203] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:53.800140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.824309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.825296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.825648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.826069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] PATH_INFO: `/v3/users/9f2ffbf0973e478694f5e8b442604486` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.827404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] RBAC: Authorizing `identity:get_user(user_id=9f2ffbf0973e478694f5e8b442604486)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.828941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.831004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 106/204] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/users/9f2ffbf0973e478694f5e8b442604486 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:53.836308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:53.886201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.921214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:53.930207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb6fd8-5bdb-4393-80fd-fd0fab4e9098 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.956104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921d39-beef-4ca4-a67b-6c13ec52d833 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:53.968786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.969503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.969815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.970099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:53.971086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] RBAC: Adding query filter params (role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=ab2c4801c1f44c8c901133b58d66f8f3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:53.971508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:53.972973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:53.985912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 99/205] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/role_assignments?user.id=ab2c4801c1f44c8c901133b58d66f8f3&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:53.992573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:53.993326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:53.993586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:53.993903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:54.072244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:54.073774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:54.150886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:54.185898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 107/206] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:42:54.191148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:54.330392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c8e60-b40f-4320-9917-ebdbb760b129 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:54.369024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:54.391727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922aafa-8b4d-4313-85c2-5dbfa6bfdda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:54.392877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922aafa-8b4d-4313-85c2-5dbfa6bfdda1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:54.393367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922aafa-8b4d-4313-85c2-5dbfa6bfdda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:54.393873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922aafa-8b4d-4313-85c2-5dbfa6bfdda1 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:54.395327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922aafa-8b4d-4313-85c2-5dbfa6bfdda1 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:54.397252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922aafa-8b4d-4313-85c2-5dbfa6bfdda1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:54.399922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 100/207] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:54 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:54.405855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:54.508505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a75c2-4e0c-4f75-b827-a6f1e09e0349 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:54.543767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c348c01-3a4f-4374-8d81-c82f8a32bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:54.544447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348c01-3a4f-4374-8d81-c82f8a32bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:54.544732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348c01-3a4f-4374-8d81-c82f8a32bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:54.545012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348c01-3a4f-4374-8d81-c82f8a32bbf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:54.545914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c348c01-3a4f-4374-8d81-c82f8a32bbf6 None admin] RBAC: Adding query filter params (role.id=3a1eebbb86f4445695d0ba65b3450de6, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb, user.id=9f2ffbf0973e478694f5e8b442604486) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:54.546234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c348c01-3a4f-4374-8d81-c82f8a32bbf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:54.547741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c348c01-3a4f-4374-8d81-c82f8a32bbf6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:54.554888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 108/208] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:54 2022] GET /identity/v3/role_assignments?user.id=9f2ffbf0973e478694f5e8b442604486&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=3a1eebbb86f4445695d0ba65b3450de6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:55.590300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b048a-7bf3-4859-9801-03641e5d677e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:55.590978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b048a-7bf3-4859-9801-03641e5d677e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:55.590978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b048a-7bf3-4859-9801-03641e5d677e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:55.592435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 101/209] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:55.597738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d989d-61a2-4951-a77c-f73987cc6d0d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:55.598220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d989d-61a2-4951-a77c-f73987cc6d0d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:55.598370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d989d-61a2-4951-a77c-f73987cc6d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:55.615496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-056d989d-61a2-4951-a77c-f73987cc6d0d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:55.616651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-056d989d-61a2-4951-a77c-f73987cc6d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:55.644294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:55.687605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 109/210] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:55.710581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b048a-7bf3-4859-9801-03641e5d677e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:55.777388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888a63-169e-41d9-9437-5ce99a0479c1 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:55.777696 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888a63-169e-41d9-9437-5ce99a0479c1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:55.778545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888a63-169e-41d9-9437-5ce99a0479c1 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:55.779852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 110/211] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:55.789188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e292-f454-4e61-8818-8b1fb8c9642c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:55.790136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e292-f454-4e61-8818-8b1fb8c9642c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:55.790548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e292-f454-4e61-8818-8b1fb8c9642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:55.811902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d763e292-f454-4e61-8818-8b1fb8c9642c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:55.813236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d763e292-f454-4e61-8818-8b1fb8c9642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:55.830920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b048a-7bf3-4859-9801-03641e5d677e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:55.869730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:55.870703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:55.871125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:55.871449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:55.882154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:55.890432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:55.891552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:42:55.892437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:55.893267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 102/212] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:55.898858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:55.902195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 111/213] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:55.927130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e292-f454-4e61-8818-8b1fb8c9642c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:55.957709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.016239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04132c3d-b3ce-4485-9070-97e7c9187258 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.035120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.043230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e292-f454-4e61-8818-8b1fb8c9642c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.075273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.076569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.077308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.078239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.079637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:56.080154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:56.081798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:56.082730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.083550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.083832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.084108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.085365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:56.087481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:56.089786 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 112/214] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:56.095380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.104829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 103/215] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:56.106354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.215200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db9d0-98f2-490c-8402-d12010a5b9b3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.234165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.244427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9851818-285a-4ed5-8793-1fcfd7335dd4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.265206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.266463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.266956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.267991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] PATH_INFO: `/v3/users/98c29c5632f74cdb8171d1d1c401f501` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.283302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886fe28-60cf-40e8-834a-ccf22e61dfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.284236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fe28-60cf-40e8-834a-ccf22e61dfcf None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.284436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fe28-60cf-40e8-834a-ccf22e61dfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.284661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fe28-60cf-40e8-834a-ccf22e61dfcf None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.285384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fe28-60cf-40e8-834a-ccf22e61dfcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:56.286871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fe28-60cf-40e8-834a-ccf22e61dfcf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:56.287545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] RBAC: Authorizing `identity:get_user(user_id=98c29c5632f74cdb8171d1d1c401f501)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:56.289232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:56.292129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 104/216] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:56 2022] GET /identity/v3/users/98c29c5632f74cdb8171d1d1c401f501 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:56.299676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.312838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 113/217] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:42:56 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:42:56.314210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e29b-fa72-4d0a-a10a-5d1d19521d13 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.314514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e29b-fa72-4d0a-a10a-5d1d19521d13 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.314797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e29b-fa72-4d0a-a10a-5d1d19521d13 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.316202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 114/218] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:56.322027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8550-20aa-4582-a1c3-80aad5f3c752 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.322319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8550-20aa-4582-a1c3-80aad5f3c752 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.322599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8550-20aa-4582-a1c3-80aad5f3c752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.344948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7e5a8550-20aa-4582-a1c3-80aad5f3c752 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:56.347098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7e5a8550-20aa-4582-a1c3-80aad5f3c752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:56.366960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.440848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 115/219] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:42:56.442585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467f97-7715-4bc0-9cd8-1cf70be6af96 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.443097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467f97-7715-4bc0-9cd8-1cf70be6af96 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.443199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42c03f-94a1-4b4a-88e4-39dd7884628b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.443687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467f97-7715-4bc0-9cd8-1cf70be6af96 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.445265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 116/220] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:56.451317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3132c5-6725-4905-9f74-b57d44e1b782 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.451901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3132c5-6725-4905-9f74-b57d44e1b782 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.452480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3132c5-6725-4905-9f74-b57d44e1b782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.471695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6a3132c5-6725-4905-9f74-b57d44e1b782 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:56.472802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6a3132c5-6725-4905-9f74-b57d44e1b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:56.482463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.483189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.483524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.483803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.533930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.550462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 117/221] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:56.551598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3132c5-6725-4905-9f74-b57d44e1b782 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.572747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:56.574364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:56.656630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.686196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3132c5-6725-4905-9f74-b57d44e1b782 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.696129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 105/222] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:42:56.698032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.728546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.729264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.729545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.729876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.740827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:56.749021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:56.749949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:56.751191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 118/223] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:56.751830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.781860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.815145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aefc7a-c686-44a1-80bc-0185ca40df0b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.852192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.853442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.854063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.854562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.859757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343749-6340-44dd-b532-6b5e79391dde None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:56.865979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:56.875490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:56.876368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:42:56.877184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:42:56.879567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 106/224] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:42:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:56.880792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.894793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:56.895661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:56.895943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:56.896486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:56.897694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:56.899739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:56.901854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 119/225] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:56 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:56.902983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:56.914052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:56.997899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340f4c-936f-4d94-9147-d49ff0ccc740 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.012224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c919ef-8bf5-4a30-8c76-b236833a1473 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.036083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.037200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.037775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.038076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.039085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:57.039414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.042094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.048171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.048924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.049279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.049626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.050385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:57.050492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:57.050896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.052364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 107/226] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:57.053703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:57.057328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.069469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 120/227] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:42:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:57.070258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:57.139604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:57.166505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a529f7f-acce-4026-8156-c446f6c516ec None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.174999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec92f-0d42-443e-970e-2b26d29104d2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.203030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.203689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.203974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.204351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.205274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=98c29c5632f74cdb8171d1d1c401f501) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:57.205592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.207191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.209870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.210740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.211025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.211304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] PATH_INFO: `/v3/users/ab2c4801c1f44c8c901133b58d66f8f3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.212577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2c4801c1f44c8c901133b58d66f8f3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.213479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 108/228] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:42:57 2022] GET /identity/v3/role_assignments?user.id=98c29c5632f74cdb8171d1d1c401f501&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:57.214040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.215830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 121/229] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:57 2022] GET /identity/v3/users/ab2c4801c1f44c8c901133b58d66f8f3 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:57.221462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:57.222283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:57.331100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:57.356890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2a48-2f61-4e29-bd0f-410290664b83 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.390619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a5a34-9392-49e4-a752-6b98b37ab900 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.446637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.447534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.447834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.448101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.450762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.452268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.460536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 122/230] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:57 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:57.466175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:57.468378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.469965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.470474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.470951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] PATH_INFO: `/v3/users/ab2c4801c1f44c8c901133b58d66f8f3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.472494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] RBAC: Authorizing `identity:get_user(user_id=ab2c4801c1f44c8c901133b58d66f8f3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.473908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:57.476050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.479915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 109/231] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:57 2022] GET /identity/v3/users/ab2c4801c1f44c8c901133b58d66f8f3 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:57.487513 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:57.647063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63415e9-5dd5-4c1c-810d-227da8c77fc5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.671569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38237a68-0bac-4801-bd83-7d4ebc057eab None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.704318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.705263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.705554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.705850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/ab2c4801c1f44c8c901133b58d66f8f3/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.707857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbc58f0cf944b9ac194be595d5b792, user_id=ab2c4801c1f44c8c901133b58d66f8f3, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.709314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.730435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:57.730947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 123/232] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:42:57 2022] PUT /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/ab2c4801c1f44c8c901133b58d66f8f3/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:42:57.762677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be5f8-cb91-467d-ac6b-ad7e531d883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.764047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be5f8-cb91-467d-ac6b-ad7e531d883e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.764539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be5f8-cb91-467d-ac6b-ad7e531d883e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.765071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be5f8-cb91-467d-ac6b-ad7e531d883e None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.766784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177be5f8-cb91-467d-ac6b-ad7e531d883e None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.768680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177be5f8-cb91-467d-ac6b-ad7e531d883e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.770851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 110/233] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:42:57 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:42:57.777701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:57.858378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:57.902971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16aa6a-fb11-40c0-b85d-ef45dab36983 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:57.939860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791dd06-68fd-42fd-9ee7-71272e258f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:57.940906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dd06-68fd-42fd-9ee7-71272e258f2d None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:57.941193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dd06-68fd-42fd-9ee7-71272e258f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:57.941471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dd06-68fd-42fd-9ee7-71272e258f2d None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/ab2c4801c1f44c8c901133b58d66f8f3/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:57.943984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791dd06-68fd-42fd-9ee7-71272e258f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbc58f0cf944b9ac194be595d5b792, user_id=ab2c4801c1f44c8c901133b58d66f8f3, role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:57.945495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791dd06-68fd-42fd-9ee7-71272e258f2d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:57.971443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 124/234] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:42:57 2022] PUT /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/ab2c4801c1f44c8c901133b58d66f8f3/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:42:59.095036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2aa791-6929-4676-9a57-feeaad9dfde5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.095558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2aa791-6929-4676-9a57-feeaad9dfde5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.095634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2aa791-6929-4676-9a57-feeaad9dfde5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.096961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 111/235] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:59.107018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892378c7-fa00-4760-a3fa-191cdaabbf4c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.107813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892378c7-fa00-4760-a3fa-191cdaabbf4c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.108237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892378c7-fa00-4760-a3fa-191cdaabbf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.129453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-892378c7-fa00-4760-a3fa-191cdaabbf4c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:59.130924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-892378c7-fa00-4760-a3fa-191cdaabbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:59.218615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 125/236] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:42:59.261287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5cad-b23b-47f2-abe1-1f49dc05a87f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.261941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5cad-b23b-47f2-abe1-1f49dc05a87f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.262422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5cad-b23b-47f2-abe1-1f49dc05a87f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.264027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 112/237] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:42:59.265218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892378c7-fa00-4760-a3fa-191cdaabbf4c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:59.280156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1df7-e62e-4e7f-8eef-e2821aa5d305 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.280751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1df7-e62e-4e7f-8eef-e2821aa5d305 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.281230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1df7-e62e-4e7f-8eef-e2821aa5d305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.303770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d7ae1df7-e62e-4e7f-8eef-e2821aa5d305 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:42:59.306172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d7ae1df7-e62e-4e7f-8eef-e2821aa5d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:42:59.360327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:59.421166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 113/238] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 03 09:42:59.433546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892378c7-fa00-4760-a3fa-191cdaabbf4c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:59.462006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae1df7-e62e-4e7f-8eef-e2821aa5d305 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:59.494100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:59.495227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.495663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.496145 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.509600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:42:59.519121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:42:59.520189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:42:59.521437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:42:59.528280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 126/239] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:42:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:42:59.530132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:59.645516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b98309-4d36-4d37-bfb9-bd11b281b847 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:59.661887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:59.684933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:59.685910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.686939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.687408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.688538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:42:59.688993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:59.690710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:59.699419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 127/240] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:42:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:59.699617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae1df7-e62e-4e7f-8eef-e2821aa5d305 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:59.705449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:59.773789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:59.819187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b11eb-d2b0-4fc0-9826-be8488ce8860 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:59.830653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:59.831465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.831792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.832027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.833226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:59.834885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:59.837029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 114/241] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:42:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:59.842117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:59.857929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:42:59.859158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:42:59.859591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:42:59.860069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] PATH_INFO: `/v3/users/ca89560d1ee6454ca8c95ec55c60fbfd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:42:59.875156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] RBAC: Authorizing `identity:get_user(user_id=ca89560d1ee6454ca8c95ec55c60fbfd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:42:59.876982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:42:59.878990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 128/242] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:42:59 2022] GET /identity/v3/users/ca89560d1ee6454ca8c95ec55c60fbfd => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:42:59.884740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:42:59.922199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:42:59.958179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70341929-81d7-4017-a2ae-bbb2b1131913 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:42:59.999772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762477c-4394-4e53-9880-11a9283c5e86 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:00.000532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe73acf-dc50-4408-a896-da87baa5a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:00.001217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73acf-dc50-4408-a896-da87baa5a2bd None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.001498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73acf-dc50-4408-a896-da87baa5a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.001786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73acf-dc50-4408-a896-da87baa5a2bd None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.002518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe73acf-dc50-4408-a896-da87baa5a2bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:00.003972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe73acf-dc50-4408-a896-da87baa5a2bd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:00.031249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 115/243] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:42:59 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:00.032749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc063f7-199b-46a2-b3f2-e7a341618475 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.033572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc063f7-199b-46a2-b3f2-e7a341618475 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.034151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc063f7-199b-46a2-b3f2-e7a341618475 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.042081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 116/244] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:00.044074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46869-e741-4926-89b9-b903f7e584e1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.044427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46869-e741-4926-89b9-b903f7e584e1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.044716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46869-e741-4926-89b9-b903f7e584e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.060225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:00.061695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.062190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.062887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.066786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9ce46869-e741-4926-89b9-b903f7e584e1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:00.068196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ce46869-e741-4926-89b9-b903f7e584e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:00.127768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:00.162596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:00.164431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:00.167476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 117/245] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:00.201197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce46869-e741-4926-89b9-b903f7e584e1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:00.268393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:00.334198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce46869-e741-4926-89b9-b903f7e584e1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:00.383321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:00.384155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.384436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.384709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.407751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:00.417729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:00.418656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:00.419445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 118/246] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:00.425078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 129/247] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:43:00.426209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:00.426563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:00.481079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:00.566195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b6e2-183d-4850-ae4f-f19a22baac01 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:00.567682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b8e70-52c4-424f-a70c-c6c769c126a2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:00.609007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:00.609682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.609999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.610382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.611231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:00.611539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:00.611733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:00.612667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.612922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:00.613078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.613413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.614842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:00.616452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:00.618450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 130/248] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:00 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:00.621697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 119/249] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:00.628382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:00.630355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:00.631914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:00.761802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:00.763339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092162c6-cff9-456e-8423-d11ad0a1072a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:00.765318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcfaaf-561b-470d-8ba2-858d418e09c8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:00.810732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a97ed-86c2-4562-b2a9-b12777d0cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:00.811615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a97ed-86c2-4562-b2a9-b12777d0cfdd None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.811901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a97ed-86c2-4562-b2a9-b12777d0cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.812181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a97ed-86c2-4562-b2a9-b12777d0cfdd None admin] PATH_INFO: `/v3/users/98c29c5632f74cdb8171d1d1c401f501` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.813770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a97ed-86c2-4562-b2a9-b12777d0cfdd None admin] RBAC: Authorizing `identity:get_user(user_id=98c29c5632f74cdb8171d1d1c401f501)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:00.815240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a97ed-86c2-4562-b2a9-b12777d0cfdd None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:00.817052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 131/250] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:00 2022] GET /identity/v3/users/98c29c5632f74cdb8171d1d1c401f501 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:00.818098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506b207-7f2c-46d8-8483-f590b619a682 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.818391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506b207-7f2c-46d8-8483-f590b619a682 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.818667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506b207-7f2c-46d8-8483-f590b619a682 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.819542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb540fe-7188-4832-83b1-9d4d2f67eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:00.820219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 132/251] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:00.820617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb540fe-7188-4832-83b1-9d4d2f67eb86 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.821645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb540fe-7188-4832-83b1-9d4d2f67eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.822155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb540fe-7188-4832-83b1-9d4d2f67eb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.823255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb540fe-7188-4832-83b1-9d4d2f67eb86 None admin] RBAC: Adding query filter params (role.id=3a1eebbb86f4445695d0ba65b3450de6, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=ca89560d1ee6454ca8c95ec55c60fbfd) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:00.823780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb540fe-7188-4832-83b1-9d4d2f67eb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:00.825427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb540fe-7188-4832-83b1-9d4d2f67eb86 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:00.825928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b066-4e19-4041-8d6f-02168c2f448c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.826257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b066-4e19-4041-8d6f-02168c2f448c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.826544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b066-4e19-4041-8d6f-02168c2f448c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.828128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 133/252] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:00.828880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b066-4e19-4041-8d6f-02168c2f448c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:00.833411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 120/253] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:00 2022] GET /identity/v3/role_assignments?user.id=ca89560d1ee6454ca8c95ec55c60fbfd&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=3a1eebbb86f4445695d0ba65b3450de6 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:00.834848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e2dd-8bb1-4eed-a3dc-7a75ba64e239 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.839455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e2dd-8bb1-4eed-a3dc-7a75ba64e239 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.839455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e2dd-8bb1-4eed-a3dc-7a75ba64e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:00.869428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8937e2dd-8bb1-4eed-a3dc-7a75ba64e239 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:00.870697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8937e2dd-8bb1-4eed-a3dc-7a75ba64e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:00.983628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:00.987149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 121/254] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:00.988810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707343d8-2eb7-465e-91c1-0b34dbbcaf22 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:00.989305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707343d8-2eb7-465e-91c1-0b34dbbcaf22 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:00.989992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707343d8-2eb7-465e-91c1-0b34dbbcaf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:01.015560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-707343d8-2eb7-465e-91c1-0b34dbbcaf22 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:01.017120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-707343d8-2eb7-465e-91c1-0b34dbbcaf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:01.045516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b066-4e19-4041-8d6f-02168c2f448c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:01.091673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:01.092954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:01.094297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:01.095534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:01.097262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:01.101081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:01.103818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 134/255] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:00 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:01.104984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:01.161101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 122/256] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:01.162026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707343d8-2eb7-465e-91c1-0b34dbbcaf22 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:01.190152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:01.263321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707343d8-2eb7-465e-91c1-0b34dbbcaf22 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:01.298550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:01.299363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:01.299702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:01.299982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/98c29c5632f74cdb8171d1d1c401f501/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:01.302002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbc58f0cf944b9ac194be595d5b792, user_id=98c29c5632f74cdb8171d1d1c401f501, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:01.303474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:01.317798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 123/257] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:43:01 2022] PUT /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/98c29c5632f74cdb8171d1d1c401f501/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:01.322694 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:01.356119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727881a-c4f6-4dd5-80d7-541d8c708782 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:01.434583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:01.435429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:01.435713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:01.435990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:01.448877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:01.457253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:01.460522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:01.461437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:01.462274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 135/258] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:01.475202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:01.536344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:01.579915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827049a-6845-4dc2-b1ed-dcfd35137614 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:01.650562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:01.651376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:01.651771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:01.652052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:01.665578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:01.677106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:01.678056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:01.679258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 124/259] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:01.687181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:01.715654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cd1a0-2752-4c75-a35a-cd56d351fb01 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:01.791309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:01.791994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:01.792278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:01.792554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:01.793310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:01.793618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:01.795053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:01.807944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 136/260] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:01.818759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:01.868079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d421-11d0-45e5-9e83-33fc4d75f089 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:01.921257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:01.921967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:01.922310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:01.922597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:01.923354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:01.923667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:01.925091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:01.938399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 125/261] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:01.943825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:01.947628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:01.970128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:02.057580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d60557-2d70-4559-b14f-81ad7efcbd1c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:02.065037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29346037-cc66-4957-abcb-4a079314b35b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:02.111372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:02.112336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:02.112628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:02.112911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] PATH_INFO: `/v3/users/ab2c4801c1f44c8c901133b58d66f8f3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:02.114266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2c4801c1f44c8c901133b58d66f8f3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:02.115887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:02.117856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 126/262] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:01 2022] GET /identity/v3/users/ab2c4801c1f44c8c901133b58d66f8f3 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:02.126965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:02.140159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:02.141159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:02.141450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:02.141729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] PATH_INFO: `/v3/users/ab2c4801c1f44c8c901133b58d66f8f3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:02.146721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] RBAC: Authorizing `identity:get_user(user_id=ab2c4801c1f44c8c901133b58d66f8f3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:02.148408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:02.150956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 137/263] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:01 2022] GET /identity/v3/users/ab2c4801c1f44c8c901133b58d66f8f3 => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:02.156163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:02.270760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:02.353313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8865b-a82f-4e3f-8549-5e742aee634f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:02.363690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a141d2-6bbf-42f7-9d96-d00e288fac74 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:02.405229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:02.419297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:02.419957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:02.420246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:02.420530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:02.494480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:02.495154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:02.495444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:02.495725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:02.562576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:02.564063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:02.698806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:02.700300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:02.788952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 138/264] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:43:02.794738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:02.838159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:02.875166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:02.898498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 127/265] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:02.904146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:03.036063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f3a1-c7aa-4b41-9df4-c7c53a05520e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:03.071533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352c4ef-af9d-4a1f-ad84-ff337c7022be None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:03.099061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:03.099940 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.100226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.100503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.102767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:03.105225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:03.112171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 139/266] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:02 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:03.119344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:03.125198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:03.126110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.126400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.126681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.128058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:03.129547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:03.131355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 128/267] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:02 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:03.137452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:03.206178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:03.300713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:03.302976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832fbf2-476f-4153-86d9-361d4e134d08 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:03.311596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f444b-cb45-4fa6-8fa8-5479e86bb3a3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:03.372570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfcd57-9257-4d82-aa65-79217249b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:03.373521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfcd57-9257-4d82-aa65-79217249b85b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.374169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfcd57-9257-4d82-aa65-79217249b85b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.374597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfcd57-9257-4d82-aa65-79217249b85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.375582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfcd57-9257-4d82-aa65-79217249b85b None admin] RBAC: Adding query filter params (role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=ab2c4801c1f44c8c901133b58d66f8f3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:03.376115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfcd57-9257-4d82-aa65-79217249b85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:03.377905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfcd57-9257-4d82-aa65-79217249b85b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:03.389785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 129/268] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:03 2022] GET /identity/v3/role_assignments?user.id=ab2c4801c1f44c8c901133b58d66f8f3&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:03.414987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eacf0-1b48-449f-b64c-fd3aec42adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:03.415654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eacf0-1b48-449f-b64c-fd3aec42adff None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.416108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eacf0-1b48-449f-b64c-fd3aec42adff None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.416558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eacf0-1b48-449f-b64c-fd3aec42adff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.417549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eacf0-1b48-449f-b64c-fd3aec42adff None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=ab2c4801c1f44c8c901133b58d66f8f3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:03.418030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eacf0-1b48-449f-b64c-fd3aec42adff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:03.419670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eacf0-1b48-449f-b64c-fd3aec42adff None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:03.431773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 140/269] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:03 2022] GET /identity/v3/role_assignments?user.id=ab2c4801c1f44c8c901133b58d66f8f3&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:03.546958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ccc79-3fba-4bfc-8f8a-e6ee9dfab089 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.547651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ccc79-3fba-4bfc-8f8a-e6ee9dfab089 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.548148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ccc79-3fba-4bfc-8f8a-e6ee9dfab089 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.550151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 130/270] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:03.556348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370d0aa-5639-4d41-82eb-9bdb80ca2183 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.556606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370d0aa-5639-4d41-82eb-9bdb80ca2183 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.556847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370d0aa-5639-4d41-82eb-9bdb80ca2183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.582230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6370d0aa-5639-4d41-82eb-9bdb80ca2183 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:03.583460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6370d0aa-5639-4d41-82eb-9bdb80ca2183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:03.679600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 141/271] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:03.724915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ccc79-3fba-4bfc-8f8a-e6ee9dfab089 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:03.766346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f070-7f29-4422-b196-6e48084e1488 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.766986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f070-7f29-4422-b196-6e48084e1488 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.767472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f070-7f29-4422-b196-6e48084e1488 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.769169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 142/272] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:43:03.792603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59a4d5-57c5-427c-a77e-644075b00fae None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.793456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59a4d5-57c5-427c-a77e-644075b00fae None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.793970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59a4d5-57c5-427c-a77e-644075b00fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.817964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dd59a4d5-57c5-427c-a77e-644075b00fae None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:03.820371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dd59a4d5-57c5-427c-a77e-644075b00fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:03.854261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ccc79-3fba-4bfc-8f8a-e6ee9dfab089 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:03.857352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:03.894298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:03.895114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:03.895402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:03.895679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:03.910930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:03.917041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 143/273] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:03.918901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:03.919779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:03.920593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:03.922249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 131/274] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:03.930953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59a4d5-57c5-427c-a77e-644075b00fae None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:03.949818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:03.954601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:04.059344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59a4d5-57c5-427c-a77e-644075b00fae None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.075570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc33ae-8e23-40c0-92b3-969aa2614bb5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.097859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46745b72-08e0-465f-aa20-291a52449541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.098788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46745b72-08e0-465f-aa20-291a52449541 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.099076 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46745b72-08e0-465f-aa20-291a52449541 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.099776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46745b72-08e0-465f-aa20-291a52449541 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.100814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46745b72-08e0-465f-aa20-291a52449541 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:04.101127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46745b72-08e0-465f-aa20-291a52449541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:04.103555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46745b72-08e0-465f-aa20-291a52449541 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:04.110040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.110833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.111123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.111417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.112571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:04.113733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 144/275] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:04.114048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:04.115308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fba597-7762-4c03-a880-f49c1b01925c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.120487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 132/276] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:04.120610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fba597-7762-4c03-a880-f49c1b01925c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.120610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fba597-7762-4c03-a880-f49c1b01925c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.120610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 145/277] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:04.122662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:04.124514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fba597-7762-4c03-a880-f49c1b01925c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:04.159647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:04.232219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d51bc-c242-4bc4-9bb7-67cc90571801 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.234089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:04.256344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fba597-7762-4c03-a880-f49c1b01925c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.266731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406a8bd-b8d7-44e1-88e0-6c1975d11e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.267612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a8bd-b8d7-44e1-88e0-6c1975d11e0f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.267896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a8bd-b8d7-44e1-88e0-6c1975d11e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.268173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a8bd-b8d7-44e1-88e0-6c1975d11e0f None admin] PATH_INFO: `/v3/users/eaba04318bdb42748de1226a0c496fc0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.281933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406a8bd-b8d7-44e1-88e0-6c1975d11e0f None admin] RBAC: Authorizing `identity:get_user(user_id=eaba04318bdb42748de1226a0c496fc0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:04.283398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406a8bd-b8d7-44e1-88e0-6c1975d11e0f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:04.285067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 133/278] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:04 2022] GET /identity/v3/users/eaba04318bdb42748de1226a0c496fc0 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:04.286331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d36f1-2d7c-4d56-a8d4-4fcf325e8dba None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.286620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d36f1-2d7c-4d56-a8d4-4fcf325e8dba None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.286897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d36f1-2d7c-4d56-a8d4-4fcf325e8dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.298675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.299565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.299987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.300399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.301241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:04.302778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fb7d36f1-2d7c-4d56-a8d4-4fcf325e8dba None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:04.303014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:04.303954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fb7d36f1-2d7c-4d56-a8d4-4fcf325e8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:04.327995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 146/279] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:43:04 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:04.329059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:04.401798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 134/280] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:04.424795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d36f1-2d7c-4d56-a8d4-4fcf325e8dba None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:04.454859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:04.498908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccefb66-36de-4721-869a-c1bfb146bf70 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.535180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad5bc1-9282-42f2-b76b-1231bae3d61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.537024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5bc1-9282-42f2-b76b-1231bae3d61a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.537307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5bc1-9282-42f2-b76b-1231bae3d61a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.537652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5bc1-9282-42f2-b76b-1231bae3d61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.540108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad5bc1-9282-42f2-b76b-1231bae3d61a None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, user.id=eaba04318bdb42748de1226a0c496fc0, scope.system=all) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:04.540108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad5bc1-9282-42f2-b76b-1231bae3d61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:04.541108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad5bc1-9282-42f2-b76b-1231bae3d61a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:04.547665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 147/281] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 3 09:43:04 2022] GET /identity/v3/role_assignments?user.id=eaba04318bdb42748de1226a0c496fc0&scope.system=all&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:04.548995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727797e-e80c-4efa-87f2-ee22e2b4ab7f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.549285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727797e-e80c-4efa-87f2-ee22e2b4ab7f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.549563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727797e-e80c-4efa-87f2-ee22e2b4ab7f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.550884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 148/282] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:04.557438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073f57-c54c-4dd4-848c-1760437a6458 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.557929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073f57-c54c-4dd4-848c-1760437a6458 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.558213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073f57-c54c-4dd4-848c-1760437a6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.561701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d36f1-2d7c-4d56-a8d4-4fcf325e8dba None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.564461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:04.580961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3a073f57-c54c-4dd4-848c-1760437a6458 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:04.582637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3a073f57-c54c-4dd4-848c-1760437a6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:04.618479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.620170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.620461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.620738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.633955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:04.642566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:04.643542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:04.644558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 135/283] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:04.650991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:04.687601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 149/284] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:04.713328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073f57-c54c-4dd4-848c-1760437a6458 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:04.755863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:04.778359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22c9f-a410-4e9e-974e-632f46c79a5c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.822336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.823456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.823748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.824033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.825147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:04.825475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:04.828619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:04.840678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 136/285] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:04.846328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:04.853561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073f57-c54c-4dd4-848c-1760437a6458 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:04.890948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:04.898301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:04.899152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:04.899443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:04.899730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:04.922143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:04.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:04.932225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:04.933045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:04.939052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 150/286] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:04.944779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:05.002066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2117b-28c7-4bc6-8a01-80febb90c8de None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:05.064900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:05.065809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:05.066192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:05.066470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] PATH_INFO: `/v3/users/ca89560d1ee6454ca8c95ec55c60fbfd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:05.067711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] RBAC: Authorizing `identity:get_user(user_id=ca89560d1ee6454ca8c95ec55c60fbfd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:05.069296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:05.071236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 137/287] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:04 2022] GET /identity/v3/users/ca89560d1ee6454ca8c95ec55c60fbfd => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:05.076708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:05.102787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:05.137099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b736604-e220-4eef-a6a5-33e77bc613cd None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:05.203504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:05.204181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:05.204466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:05.204743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:05.205500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:05.205835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:05.207242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:05.230785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 151/288] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:05.236089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:05.267345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34db4b8-cc32-4222-bf46-5e7aadb9947f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:05.305588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:05.327672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:05.328611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:05.328906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:05.329191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:05.330562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:05.332035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:05.334084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 138/289] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:05 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:05.340091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:05.354946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd4980-8f7a-4d93-997e-e0f4f636bb1a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:05.400155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:05.401037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:05.401321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:05.401595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] PATH_INFO: `/v3/users/98c29c5632f74cdb8171d1d1c401f501` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:05.402835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] RBAC: Authorizing `identity:get_user(user_id=98c29c5632f74cdb8171d1d1c401f501)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:05.404279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:05.410495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 152/290] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:05 2022] GET /identity/v3/users/98c29c5632f74cdb8171d1d1c401f501 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:05.411718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:05.516797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45ce0-71ba-486b-ac15-ef8d8b20479b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:05.540879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:05.545610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:05.554388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:05.555039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:05.555937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:05.556220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:05.603650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b0487-a9b1-4630-8081-94d5dd7b775e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:05.640115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:05.641516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:05.663547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:05.664468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:05.665329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:05.665616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/ca89560d1ee6454ca8c95ec55c60fbfd/roles/3a1eebbb86f4445695d0ba65b3450de6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:05.668573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbc58f0cf944b9ac194be595d5b792, user_id=ca89560d1ee6454ca8c95ec55c60fbfd, role_id=3a1eebbb86f4445695d0ba65b3450de6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:05.670061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:05.693938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 139/291] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:43:05 2022] PUT /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/users/ca89560d1ee6454ca8c95ec55c60fbfd/roles/3a1eebbb86f4445695d0ba65b3450de6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:43:05.821393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 153/292] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:05.827399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:05.988994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf767f-1d6a-4b4e-a3cc-8f2db0d61e25 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:06.035407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fd5d0-2333-4a6f-8c10-5d5e0b702472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:06.036283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fd5d0-2333-4a6f-8c10-5d5e0b702472 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:06.036566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fd5d0-2333-4a6f-8c10-5d5e0b702472 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:06.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fd5d0-2333-4a6f-8c10-5d5e0b702472 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:06.038055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fd5d0-2333-4a6f-8c10-5d5e0b702472 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:06.040043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fd5d0-2333-4a6f-8c10-5d5e0b702472 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:06.042038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 140/293] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:05 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:06.047748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:06.073559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:06.177617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60a00f-87f2-48cc-80cd-9109fc25a010 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:06.221223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3774c1-814c-42df-9e87-60525813a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:06.222145 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3774c1-814c-42df-9e87-60525813a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:06.222573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3774c1-814c-42df-9e87-60525813a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:06.223022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3774c1-814c-42df-9e87-60525813a4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:06.223997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3774c1-814c-42df-9e87-60525813a4f5 None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=98c29c5632f74cdb8171d1d1c401f501) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:06.224453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3774c1-814c-42df-9e87-60525813a4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:06.226221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3774c1-814c-42df-9e87-60525813a4f5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:06.237996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 154/294] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:06 2022] GET /identity/v3/role_assignments?user.id=98c29c5632f74cdb8171d1d1c401f501&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:07.074346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df5b7-168c-4836-910d-a37b12891e3a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.074904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df5b7-168c-4836-910d-a37b12891e3a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.075195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df5b7-168c-4836-910d-a37b12891e3a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.077158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 141/295] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:07.078233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52737a8e-54bc-4f55-b7b7-59ed9c0d42d8 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.078636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52737a8e-54bc-4f55-b7b7-59ed9c0d42d8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.078754 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52737a8e-54bc-4f55-b7b7-59ed9c0d42d8 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.080119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 155/296] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:43:07.082744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01db2-0bfc-4e18-97db-15bffaf892bf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.083118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01db2-0bfc-4e18-97db-15bffaf892bf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.083404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01db2-0bfc-4e18-97db-15bffaf892bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.085896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b770-890e-4086-aab9-206559a23afc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.086181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b770-890e-4086-aab9-206559a23afc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.086595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b770-890e-4086-aab9-206559a23afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.096433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:07.102305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-80b01db2-0bfc-4e18-97db-15bffaf892bf None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:07.104407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-80b01db2-0bfc-4e18-97db-15bffaf892bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:07.106926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2737b770-890e-4086-aab9-206559a23afc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:07.108223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2737b770-890e-4086-aab9-206559a23afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:07.179772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 142/297] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:07.194375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 156/298] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:07.202791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01db2-0bfc-4e18-97db-15bffaf892bf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.223534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b770-890e-4086-aab9-206559a23afc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.258185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:07.307418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01db2-0bfc-4e18-97db-15bffaf892bf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.332779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b770-890e-4086-aab9-206559a23afc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.342361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.343518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.343805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.344080 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.347495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:07.359232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:07.370074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:07.370954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:07.371746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 143/299] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:07.373564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1dc7a-53a5-4430-9a19-4121342c7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.374510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1dc7a-53a5-4430-9a19-4121342c7e09 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.374911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1dc7a-53a5-4430-9a19-4121342c7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.375294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1dc7a-53a5-4430-9a19-4121342c7e09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.378691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.392228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1dc7a-53a5-4430-9a19-4121342c7e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2ea1dc7a-53a5-4430-9a19-4121342c7e09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:07.401652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:07.402739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:07.403541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:07.404127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 157/300] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:07.404855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f4e9-e66d-4e10-867b-7af6de423aeb None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.405374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f4e9-e66d-4e10-867b-7af6de423aeb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.405890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f4e9-e66d-4e10-867b-7af6de423aeb None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.407783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 158/301] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:07.409037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f4e9-e66d-4e10-867b-7af6de423aeb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.491387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:07.500003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e732-288f-4e7d-a7b3-a3fd48ef54bd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.517532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f4e9-e66d-4e10-867b-7af6de423aeb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.536885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24023d6c-4f7f-40c9-9e48-6ff3b8993795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.537561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24023d6c-4f7f-40c9-9e48-6ff3b8993795 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.537879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24023d6c-4f7f-40c9-9e48-6ff3b8993795 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.538353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24023d6c-4f7f-40c9-9e48-6ff3b8993795 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.539095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24023d6c-4f7f-40c9-9e48-6ff3b8993795 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:07.539557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24023d6c-4f7f-40c9-9e48-6ff3b8993795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:07.540866 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24023d6c-4f7f-40c9-9e48-6ff3b8993795 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:07.549795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 144/302] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:07.551158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b92d-ab1d-4886-87e6-c65bdd7c2775 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.551620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b92d-ab1d-4886-87e6-c65bdd7c2775 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.552047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b92d-ab1d-4886-87e6-c65bdd7c2775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.556412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.557078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.557370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.557654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.558456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:07.558764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:07.560138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:07.573352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 159/303] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:07.573518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2bf2b92d-ab1d-4886-87e6-c65bdd7c2775 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:07.573611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.573692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2bf2b92d-ab1d-4886-87e6-c65bdd7c2775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:07.627829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:07.643021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 145/304] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:07.649932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b92d-ab1d-4886-87e6-c65bdd7c2775 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.699234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887275c5-7d25-47b3-b9e2-7693627a6e3e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.734977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.735966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.736369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.736651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] PATH_INFO: `/v3/users/eaba04318bdb42748de1226a0c496fc0` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.737882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] RBAC: Authorizing `identity:get_user(user_id=eaba04318bdb42748de1226a0c496fc0)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:07.739693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:07.746440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 160/305] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/users/eaba04318bdb42748de1226a0c496fc0 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:07.746440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.749983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b92d-ab1d-4886-87e6-c65bdd7c2775 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.754180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:07.785600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.786502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.786785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.787057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] PATH_INFO: `/v3/users/776c952d4641442184bb00faf8048abd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.802325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] RBAC: Authorizing `identity:get_user(user_id=776c952d4641442184bb00faf8048abd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:07.803785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:07.810870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 146/306] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/users/776c952d4641442184bb00faf8048abd => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:07.810870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.857905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:07.870663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e2e7a-748b-40b7-b761-80fa871126c0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.906923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.907636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.907924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.908348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.909365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:07.910852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:07.916930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 161/307] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:07.916930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:07.917133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73caece-2582-4245-a928-b1f821ebd775 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:07.952559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:07.953421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:07.953698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:07.954007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] PATH_INFO: `/v3/system/users/eaba04318bdb42748de1226a0c496fc0/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:07.955459 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eaba04318bdb42748de1226a0c496fc0, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:07.956841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:07.965352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 147/308] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Jun 3 09:43:07 2022] PUT /identity/v3/system/users/eaba04318bdb42748de1226a0c496fc0/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:07.966172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:08.023929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:08.054992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3c87-fed7-4b0b-821f-056e4d750149 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:08.096122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8a520-efa1-464e-9eb7-00f637f8569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:08.096768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8a520-efa1-464e-9eb7-00f637f8569d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:08.097047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8a520-efa1-464e-9eb7-00f637f8569d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:08.097373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8a520-efa1-464e-9eb7-00f637f8569d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:08.098337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8a520-efa1-464e-9eb7-00f637f8569d None admin] RBAC: Adding query filter params (role.id=3a1eebbb86f4445695d0ba65b3450de6, user.id=776c952d4641442184bb00faf8048abd, scope.system=all) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:08.098694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8a520-efa1-464e-9eb7-00f637f8569d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:08.100238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8a520-efa1-464e-9eb7-00f637f8569d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:08.106490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 162/309] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 3 09:43:07 2022] GET /identity/v3/role_assignments?user.id=776c952d4641442184bb00faf8048abd&scope.system=all&role.id=3a1eebbb86f4445695d0ba65b3450de6 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:08.127100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b62df-2029-4072-8e52-4532937e29a8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:08.142492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:08.172906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fded590-956a-415a-a0cb-20d922846ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:08.173916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded590-956a-415a-a0cb-20d922846ac1 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:08.174388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded590-956a-415a-a0cb-20d922846ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:08.174846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded590-956a-415a-a0cb-20d922846ac1 None admin] PATH_INFO: `/v3/groups` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:08.175744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fded590-956a-415a-a0cb-20d922846ac1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:08.177498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fded590-956a-415a-a0cb-20d922846ac1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:08.198636 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 148/310] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Jun 3 09:43:07 2022] POST /identity/v3/groups => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:08.344065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600887d-36b8-41e6-872e-33e9e0b01c48 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:08.344354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600887d-36b8-41e6-872e-33e9e0b01c48 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:08.344640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600887d-36b8-41e6-872e-33e9e0b01c48 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:08.346359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 163/311] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:08.352908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4709d-62f8-4feb-9be6-c24b928e650c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:08.353199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4709d-62f8-4feb-9be6-c24b928e650c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:08.353497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4709d-62f8-4feb-9be6-c24b928e650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:08.373203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-31a4709d-62f8-4feb-9be6-c24b928e650c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:08.375196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-31a4709d-62f8-4feb-9be6-c24b928e650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:08.452273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 149/312] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:08.485477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600887d-36b8-41e6-872e-33e9e0b01c48 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:08.599222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600887d-36b8-41e6-872e-33e9e0b01c48 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:08.635462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:08.636319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:08.636607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:08.636884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:08.644531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:08.649892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:08.658532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:08.659388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:08.660178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 164/313] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:08.665649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4709d-62f8-4feb-9be6-c24b928e650c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:08.768702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:08.771790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4709d-62f8-4feb-9be6-c24b928e650c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:08.817122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:08.817809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:08.818098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:08.818370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:08.819112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:08.819415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:08.821364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:08.830515 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 150/314] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:08.836387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:08.942388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c000c2-9a6c-4ca5-8258-c9107d2a4bc4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:08.979036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:08.979914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:08.980201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:08.980481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] PATH_INFO: `/v3/users/ca89560d1ee6454ca8c95ec55c60fbfd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:08.981688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] RBAC: Authorizing `identity:get_user(user_id=ca89560d1ee6454ca8c95ec55c60fbfd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:08.983170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:08.985098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 165/315] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:08 2022] GET /identity/v3/users/ca89560d1ee6454ca8c95ec55c60fbfd => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:08.990565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:09.095232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6303b-8518-4822-bd28-c5a03c6d1c12 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:09.130620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:09.131473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:09.131631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:09.131828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:09.164359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:09.207199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:09.208688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:09.314611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 151/316] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:09.320080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:09.389670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:09.425427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61fca5-787f-4add-a920-3554bcf3ae20 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:09.462985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daa882-d887-4af2-8f6d-677cec75bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:09.463848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa882-d887-4af2-8f6d-677cec75bd49 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:09.464136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa882-d887-4af2-8f6d-677cec75bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:09.464423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa882-d887-4af2-8f6d-677cec75bd49 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:09.465615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daa882-d887-4af2-8f6d-677cec75bd49 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:09.467098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daa882-d887-4af2-8f6d-677cec75bd49 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:09.469107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 166/317] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:09 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:09.474901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:09.539541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:09.579699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b081-633a-4ff3-9999-33ed4e13a273 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:09.614793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89e18-4484-4b6f-8f87-d959bb6d1b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:09.615452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89e18-4484-4b6f-8f87-d959bb6d1b1a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:09.615738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89e18-4484-4b6f-8f87-d959bb6d1b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:09.616019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89e18-4484-4b6f-8f87-d959bb6d1b1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:09.616847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89e18-4484-4b6f-8f87-d959bb6d1b1a None admin] RBAC: Adding query filter params (role.id=3a1eebbb86f4445695d0ba65b3450de6, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792, user.id=ca89560d1ee6454ca8c95ec55c60fbfd) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:09.617161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89e18-4484-4b6f-8f87-d959bb6d1b1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:09.619182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89e18-4484-4b6f-8f87-d959bb6d1b1a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:09.625398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 152/318] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:09 2022] GET /identity/v3/role_assignments?user.id=ca89560d1ee6454ca8c95ec55c60fbfd&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=3a1eebbb86f4445695d0ba65b3450de6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:10.342878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb930e7e-c1a2-480b-8663-0f20271b1849 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.343431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb930e7e-c1a2-480b-8663-0f20271b1849 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.343698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb930e7e-c1a2-480b-8663-0f20271b1849 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.345084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 167/319] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:10.350096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f329-e696-483f-a591-c49f85fd6dec None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.350471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f329-e696-483f-a591-c49f85fd6dec None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.350668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f329-e696-483f-a591-c49f85fd6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.367390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3d10f329-e696-483f-a591-c49f85fd6dec None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:10.369113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3d10f329-e696-483f-a591-c49f85fd6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:10.413111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f416-403a-434a-9101-42cbda1bda57 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.413398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f416-403a-434a-9101-42cbda1bda57 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.413917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f416-403a-434a-9101-42cbda1bda57 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.415314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 168/320] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:43:10.420887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d814d-f066-4c1e-8817-1ae18ba60def None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.421178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d814d-f066-4c1e-8817-1ae18ba60def None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.421459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d814d-f066-4c1e-8817-1ae18ba60def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.438422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-613d814d-f066-4c1e-8817-1ae18ba60def None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:10.439599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-613d814d-f066-4c1e-8817-1ae18ba60def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:10.456919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 153/321] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:10.480590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f329-e696-483f-a591-c49f85fd6dec None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:10.510134 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 169/322] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:10.532877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d814d-f066-4c1e-8817-1ae18ba60def None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:10.541168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:10.588873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f329-e696-483f-a591-c49f85fd6dec None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:10.597171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:10.623101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502215e-98e7-4bc8-b85a-76f6a4f14e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:10.623884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502215e-98e7-4bc8-b85a-76f6a4f14e32 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.624168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502215e-98e7-4bc8-b85a-76f6a4f14e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.624445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502215e-98e7-4bc8-b85a-76f6a4f14e32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.634660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502215e-98e7-4bc8-b85a-76f6a4f14e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:10.636664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d814d-f066-4c1e-8817-1ae18ba60def None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-9502215e-98e7-4bc8-b85a-76f6a4f14e32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:10.642249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:10.643250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:10.644035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 154/323] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:10.644847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38c55-b56e-434c-bb79-2f8c36e8c5b3 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.645079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38c55-b56e-434c-bb79-2f8c36e8c5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.645348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38c55-b56e-434c-bb79-2f8c36e8c5b3 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.646853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 155/324] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:10.649522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38c55-b56e-434c-bb79-2f8c36e8c5b3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:10.676698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989c09d-7262-434a-ad5f-8654ad0b0d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:10.677489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989c09d-7262-434a-ad5f-8654ad0b0d43 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.677860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989c09d-7262-434a-ad5f-8654ad0b0d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.678139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989c09d-7262-434a-ad5f-8654ad0b0d43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.689072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989c09d-7262-434a-ad5f-8654ad0b0d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b989c09d-7262-434a-ad5f-8654ad0b0d43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:10.696668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:10.697604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:10.698416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 170/325] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:10.699069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693f3f0-bd7c-44b6-8706-51607d6b6555 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.699383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693f3f0-bd7c-44b6-8706-51607d6b6555 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.699656 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693f3f0-bd7c-44b6-8706-51607d6b6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.716318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1693f3f0-bd7c-44b6-8706-51607d6b6555 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:10.717480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1693f3f0-bd7c-44b6-8706-51607d6b6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:10.751427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38c55-b56e-434c-bb79-2f8c36e8c5b3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:10.766485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:10.782622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 171/326] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:10.783450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693f3f0-bd7c-44b6-8706-51607d6b6555 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:10.783923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:10.784589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.784872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.785148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.785962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:10.786275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:10.787644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:10.796574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 156/327] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:10.801883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:10.841391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:10.884348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693f3f0-bd7c-44b6-8706-51607d6b6555 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:10.896729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856b776-6d0b-452e-94bb-e07243b9a654 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:10.917961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:10.918628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.918920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.919201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.919947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:10.920263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:10.921646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:10.929518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 172/328] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:10.930460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:10.930593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:10.931607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:10.932032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:10.932445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] PATH_INFO: `/v3/users/eaba04318bdb42748de1226a0c496fc0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:10.933778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] RBAC: Authorizing `identity:get_user(user_id=eaba04318bdb42748de1226a0c496fc0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:10.935478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:10.937082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 157/329] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:10 2022] GET /identity/v3/users/eaba04318bdb42748de1226a0c496fc0 => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:10.938012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:10.987124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:11.031016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f4c05-1955-4db9-83d7-3209ec8f066d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:11.040990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab926589-565f-4ff2-a084-13fd7ba6bad4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:11.046878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:11.065855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:11.066648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:11.066932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:11.067210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:11.068355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:11.069871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:11.071483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 173/330] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:11.072229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:11.076465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:11.077336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:11.077620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:11.077955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] PATH_INFO: `/v3/users/776c952d4641442184bb00faf8048abd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:11.079161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] RBAC: Authorizing `identity:get_user(user_id=776c952d4641442184bb00faf8048abd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:11.080923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:11.082288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 158/331] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:10 2022] GET /identity/v3/users/776c952d4641442184bb00faf8048abd => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:11.083016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:11.170172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8672b-fb1e-498e-a096-7f0f460559ef None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:11.181988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490826-03fd-4540-b8a3-84f9d8f9b613 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:11.195485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:11.205054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:11.205702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:11.206018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:11.206297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:11.207119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] RBAC: Adding query filter params (role.id=ad92bcd216834a4d94b428c07289fd02, user.id=eaba04318bdb42748de1226a0c496fc0, scope.system=all) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:11.207432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:11.208864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:11.215994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429c6be-9fcc-43ab-9e9c-d70813ee9643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:11.216650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429c6be-9fcc-43ab-9e9c-d70813ee9643 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:11.216934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429c6be-9fcc-43ab-9e9c-d70813ee9643 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:11.217211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429c6be-9fcc-43ab-9e9c-d70813ee9643 None admin] PATH_INFO: `/v3/groups` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:11.217921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429c6be-9fcc-43ab-9e9c-d70813ee9643 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:11.219336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429c6be-9fcc-43ab-9e9c-d70813ee9643 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:11.221054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 174/332] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 3 09:43:11 2022] GET /identity/v3/role_assignments?user.id=eaba04318bdb42748de1226a0c496fc0&scope.system=all&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 510 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:11.221832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:11.246861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 159/333] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Jun 3 09:43:11 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:11.273577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:11.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bafb68-4ef3-4fa0-b477-63af89564031 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:11.390837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4c6b0-dc9a-4c2f-89d7-8ca9722690c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:11.391613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4c6b0-dc9a-4c2f-89d7-8ca9722690c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:11.391906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4c6b0-dc9a-4c2f-89d7-8ca9722690c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:11.392191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4c6b0-dc9a-4c2f-89d7-8ca9722690c2 None admin] PATH_INFO: `/v3/system/users/776c952d4641442184bb00faf8048abd/roles/3a1eebbb86f4445695d0ba65b3450de6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:11.393924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4c6b0-dc9a-4c2f-89d7-8ca9722690c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=776c952d4641442184bb00faf8048abd, role_id=3a1eebbb86f4445695d0ba65b3450de6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:11.395417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4c6b0-dc9a-4c2f-89d7-8ca9722690c2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:11.412744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 175/334] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Jun 3 09:43:11 2022] PUT /identity/v3/system/users/776c952d4641442184bb00faf8048abd/roles/3a1eebbb86f4445695d0ba65b3450de6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:13.754431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2d43-43df-4f9b-9686-89d0892d6d8a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:13.754968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2d43-43df-4f9b-9686-89d0892d6d8a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:13.754968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2d43-43df-4f9b-9686-89d0892d6d8a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:13.756646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 160/335] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:13.761872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993765-322f-4d15-8d65-171e30a77b06 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:13.762725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993765-322f-4d15-8d65-171e30a77b06 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:13.763205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993765-322f-4d15-8d65-171e30a77b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:13.785306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-21993765-322f-4d15-8d65-171e30a77b06 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:13.786845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-21993765-322f-4d15-8d65-171e30a77b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:13.881247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 176/336] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:13.906735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5bf4c-37d2-4d63-a123-b45a0e602df7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:13.907396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5bf4c-37d2-4d63-a123-b45a0e602df7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:13.907902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5bf4c-37d2-4d63-a123-b45a0e602df7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:13.909566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 161/337] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:13.915876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e34f5-d831-4e38-8e1d-2ef4407870ce None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:13.916684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e34f5-d831-4e38-8e1d-2ef4407870ce None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:13.917179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e34f5-d831-4e38-8e1d-2ef4407870ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:13.921121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5bf4c-37d2-4d63-a123-b45a0e602df7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:13.964490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5e1e34f5-d831-4e38-8e1d-2ef4407870ce None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:13.965694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5e1e34f5-d831-4e38-8e1d-2ef4407870ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:14.037673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:14.107408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5bf4c-37d2-4d63-a123-b45a0e602df7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:14.123451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 177/338] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:14.154703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:14.155524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:14.155810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:14.156085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:14.168146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:14.175890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:14.176817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:14.178074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 162/339] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:14.180131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e34f5-d831-4e38-8e1d-2ef4407870ce None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:14.183132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:14.249511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:14.354334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386c66-a4cf-4678-b56d-6b9e213ca10a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:14.395649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e34f5-d831-4e38-8e1d-2ef4407870ce None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:14.435776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2091de0-624f-4d5e-8ffb-b80ab7f41c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:14.436477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091de0-624f-4d5e-8ffb-b80ab7f41c3e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:14.436908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091de0-624f-4d5e-8ffb-b80ab7f41c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:14.438359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091de0-624f-4d5e-8ffb-b80ab7f41c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:14.439315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091de0-624f-4d5e-8ffb-b80ab7f41c3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:14.439681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091de0-624f-4d5e-8ffb-b80ab7f41c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:14.440141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f8768-fc51-4619-ba48-8fcf4c214ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:14.441099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091de0-624f-4d5e-8ffb-b80ab7f41c3e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:14.441447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8768-fc51-4619-ba48-8fcf4c214ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:14.441962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8768-fc51-4619-ba48-8fcf4c214ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:14.442454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8768-fc51-4619-ba48-8fcf4c214ce8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:14.459146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f8768-fc51-4619-ba48-8fcf4c214ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:14.461965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 163/340] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:14.467321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081b78-d478-4c9d-91a0-4fea5c44f81e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f84f8768-fc51-4619-ba48-8fcf4c214ce8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:14.472028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:14.472904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 09:43:14.473703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:14.475146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081b78-d478-4c9d-91a0-4fea5c44f81e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:14.475637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081b78-d478-4c9d-91a0-4fea5c44f81e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:14.477265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 164/341] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:14.482195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081b78-d478-4c9d-91a0-4fea5c44f81e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:14.486822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 178/342] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:14.489449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee48b-7e19-418a-a117-cd6e4ecee92a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:14.494835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee48b-7e19-418a-a117-cd6e4ecee92a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:14.495343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee48b-7e19-418a-a117-cd6e4ecee92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:14.525426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d79ee48b-7e19-418a-a117-cd6e4ecee92a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:14.527938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d79ee48b-7e19-418a-a117-cd6e4ecee92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:14.574142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:14.666152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 179/343] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:14.667448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee48b-7e19-418a-a117-cd6e4ecee92a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:14.682114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:14.697064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081b78-d478-4c9d-91a0-4fea5c44f81e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:14.753400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:14.753969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:14.754300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:14.754593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:14.790943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ee48b-7e19-418a-a117-cd6e4ecee92a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:14.831130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:14.832263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:14.832757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:14.833248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:14.834234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:14.834754 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:14.837068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:14.847013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 180/344] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:14.848163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:14.849233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:14.854996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:14.874211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:14.961827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ce4a6-5ead-47f9-a686-b853f6916564 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:14.984550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:14.995594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 165/345] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:14.998649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.009899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.011060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.011543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.012116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.023615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:15.032303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:15.033197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:15.034046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:15.036424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 181/346] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:15.038554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.140240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:15.150986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03b349-e17e-4f03-9836-f5a3161e8d5a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:15.152841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf47516-b711-4eb5-a533-5f5162e53b9d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:15.189425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.190761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.191263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.191738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.193266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:15.194967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:15.197420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 182/347] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:15.198277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592efbb6-44ee-48a7-a5da-ff96a44daa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.198767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.199295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592efbb6-44ee-48a7-a5da-ff96a44daa26 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.199654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592efbb6-44ee-48a7-a5da-ff96a44daa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.199996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592efbb6-44ee-48a7-a5da-ff96a44daa26 None admin] PATH_INFO: `/v3/users/776c952d4641442184bb00faf8048abd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.201397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592efbb6-44ee-48a7-a5da-ff96a44daa26 None admin] RBAC: Authorizing `identity:get_user(user_id=776c952d4641442184bb00faf8048abd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:15.204425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592efbb6-44ee-48a7-a5da-ff96a44daa26 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:15.206327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 166/348] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:43:14 2022] GET /identity/v3/users/776c952d4641442184bb00faf8048abd => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:15.207707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cee51-4d18-4088-a71e-552775933cb6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.208153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cee51-4d18-4088-a71e-552775933cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.208587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cee51-4d18-4088-a71e-552775933cb6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.210769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 167/349] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:15.211727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cee51-4d18-4088-a71e-552775933cb6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.299519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:15.330963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaebfb-f958-41f1-b866-d42ecce3d6d0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:15.346212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cee51-4d18-4088-a71e-552775933cb6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:15.381051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.382371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.382919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.383478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.384449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:15.385000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:15.387120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:15.401980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec26691-a00a-452f-9e98-e44bd00c3b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.401980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26691-a00a-452f-9e98-e44bd00c3b96 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.401980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26691-a00a-452f-9e98-e44bd00c3b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.401980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26691-a00a-452f-9e98-e44bd00c3b96 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.403496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 183/350] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:15.404741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.412014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec26691-a00a-452f-9e98-e44bd00c3b96 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:15.412158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec26691-a00a-452f-9e98-e44bd00c3b96 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:15.414929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 168/351] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:15.416278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b476e-2f2f-4532-b359-900fcaa15749 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.417278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b476e-2f2f-4532-b359-900fcaa15749 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.417579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b476e-2f2f-4532-b359-900fcaa15749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.421160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:15.443490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-716b476e-2f2f-4532-b359-900fcaa15749 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:15.445328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-716b476e-2f2f-4532-b359-900fcaa15749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:15.538399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 169/352] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:15.539959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b476e-2f2f-4532-b359-900fcaa15749 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.541560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ea7db-0b23-4caf-b137-652e38d2204d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:15.593478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.594111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.594401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.594682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.595860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] RBAC: Adding query filter params (role.id=3a1eebbb86f4445695d0ba65b3450de6, user.id=776c952d4641442184bb00faf8048abd, scope.system=all) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:15.596182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:15.597943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:15.613514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:15.614376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 184/353] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/role_assignments?user.id=776c952d4641442184bb00faf8048abd&scope.system=all&role.id=3a1eebbb86f4445695d0ba65b3450de6 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:15.615222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.670651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b476e-2f2f-4532-b359-900fcaa15749 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:15.700522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:15.729288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371cfc5-d66e-4e08-84b1-4330f3e167f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.730411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371cfc5-d66e-4e08-84b1-4330f3e167f8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.730943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371cfc5-d66e-4e08-84b1-4330f3e167f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.731424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371cfc5-d66e-4e08-84b1-4330f3e167f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.794823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33b4ef-9e0e-4e4b-a706-33ff3a6788d4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:15.848319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371cfc5-d66e-4e08-84b1-4330f3e167f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:15.850526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371cfc5-d66e-4e08-84b1-4330f3e167f8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:15.871813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:15.872491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.872778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.873059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.873942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:15.874261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:15.875740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:15.883252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 185/354] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 260 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:15.884123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:15.922176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:15.964666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 170/355] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:15.966878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14596394-30f8-4fa2-b9e0-9b0ca568509b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:15.967175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14596394-30f8-4fa2-b9e0-9b0ca568509b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:15.967551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14596394-30f8-4fa2-b9e0-9b0ca568509b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:15.969283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 171/356] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:15.970031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14596394-30f8-4fa2-b9e0-9b0ca568509b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.012275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45cb1e-248a-4676-a418-cf4389f9f144 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.045480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:16.052025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0226b-ba31-4d8a-b796-bbb4c21f7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.052917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0226b-ba31-4d8a-b796-bbb4c21f7b96 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.053275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0226b-ba31-4d8a-b796-bbb4c21f7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.053628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0226b-ba31-4d8a-b796-bbb4c21f7b96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.067936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0226b-ba31-4d8a-b796-bbb4c21f7b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-01f0226b-ba31-4d8a-b796-bbb4c21f7b96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:16.076262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:16.077428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:16.079236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:16.081834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 186/357] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:16.083350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cbad4-ae6e-4f31-8cdd-fd071f74d47e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.083818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cbad4-ae6e-4f31-8cdd-fd071f74d47e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.084242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cbad4-ae6e-4f31-8cdd-fd071f74d47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.103502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-997cbad4-ae6e-4f31-8cdd-fd071f74d47e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:16.104553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14596394-30f8-4fa2-b9e0-9b0ca568509b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.105082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-997cbad4-ae6e-4f31-8cdd-fd071f74d47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:16.147786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.150296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.151007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.151584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.154075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:16.155819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:16.157775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 172/358] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:15 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:16.158833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.191287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:16.192479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 187/359] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:16.193710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cbad4-ae6e-4f31-8cdd-fd071f74d47e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.296515 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138b7d3-0c56-45b9-8889-043acbbfd2ed None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.305958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cbad4-ae6e-4f31-8cdd-fd071f74d47e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.335008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:16.337889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414aa5c-43fe-40a6-aa81-4890ae763d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.338572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414aa5c-43fe-40a6-aa81-4890ae763d08 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.338912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414aa5c-43fe-40a6-aa81-4890ae763d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.339130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414aa5c-43fe-40a6-aa81-4890ae763d08 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.340130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414aa5c-43fe-40a6-aa81-4890ae763d08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:16.340447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414aa5c-43fe-40a6-aa81-4890ae763d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:16.342025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414aa5c-43fe-40a6-aa81-4890ae763d08 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:16.352545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 173/360] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:16.353924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979f71-41c2-42ff-a5e2-8c41f9be6b83 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.354158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979f71-41c2-42ff-a5e2-8c41f9be6b83 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.354438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979f71-41c2-42ff-a5e2-8c41f9be6b83 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.355659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.355929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 174/361] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:16.356633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43979f71-41c2-42ff-a5e2-8c41f9be6b83 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.357948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.358240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.358564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.362522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:16.364106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:16.365964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 188/362] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:16.366964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.481772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:16.501983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43979f71-41c2-42ff-a5e2-8c41f9be6b83 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.510822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74844da-e30e-4c52-be7d-a58013d2a6ed None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.542198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e282ba-2b3c-44a3-9920-433d93322fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.543014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e282ba-2b3c-44a3-9920-433d93322fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.543301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e282ba-2b3c-44a3-9920-433d93322fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.543582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e282ba-2b3c-44a3-9920-433d93322fb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.549304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.549990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.550275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.550551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.556214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e282ba-2b3c-44a3-9920-433d93322fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-38e282ba-2b3c-44a3-9920-433d93322fb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:16.565205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:16.566123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:16.566927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:16.568052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 175/363] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:16.568392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ac2f-178f-4f0b-84a6-3a51db713428 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.568688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ac2f-178f-4f0b-84a6-3a51db713428 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.568966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ac2f-178f-4f0b-84a6-3a51db713428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.587980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e894ac2f-178f-4f0b-84a6-3a51db713428 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:16.589163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e894ac2f-178f-4f0b-84a6-3a51db713428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:16.618731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:16.642159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:16.643647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:16.679679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 176/364] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:16.682653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894ac2f-178f-4f0b-84a6-3a51db713428 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.778712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:16.789674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 189/365] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:16.791321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.812040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894ac2f-178f-4f0b-84a6-3a51db713428 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.856413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.857072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.857663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.858188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.859233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:16.859555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:16.861016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:16.868479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 177/366] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:16.870587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:16.899755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:16.919600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c8a8f-5c30-4804-bb82-4356051a9ba0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:16.971490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:16.972217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:16.972563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:16.972849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:16.974042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:16.974356 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:16.976107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:16.993793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 190/367] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:16.993793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.007539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f684adf-3ff4-4b52-8f9b-5c80338d78be None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.046935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.047757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.048048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.048693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.062162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:17.072006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:17.072976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:17.073778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 178/368] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:17.078756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.083155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:17.120391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86863-2f14-4929-b1ed-7817ea2e08fe None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.162986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.164462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.164751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.165030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.166481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:17.168005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:17.170091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 191/369] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:16 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:17.170613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.195248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:17.244300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3fa2-0610-4a99-a9de-5c6b78a1ca04 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.289085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.290795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.291686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.292115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.304126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6896e25-605f-4b15-a854-dd08b8268ab2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.346322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.347238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.347691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.348123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.349015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:17.349465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:17.351048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:17.362000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 192/370] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:17.363123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.382824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:17.385226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:17.387447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:17.495076 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:17.522083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 179/371] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:17.525495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.526033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8b21-5676-4755-96f2-41a66653743e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.575738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.576597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.576887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.577590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.578827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:17.580633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:17.584984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 193/372] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:17.585796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.658471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011c344-4f08-4415-9e21-603673c9ae4d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.660253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:17.700642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.701578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.702080 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.702522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.723738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df9d21-8935-4fc8-a14e-74307581787a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.770229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.771175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.771756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.772380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.773863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:17.775311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:17.778078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 194/373] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:17.781794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.783569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:17.784632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:17.808601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:17.895791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 180/374] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:17.896905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:17.901772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:17.918368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d493aa7-1861-4a30-9cf5-beb1bae5b916 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:17.954893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:17.955785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:17.956208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:17.956655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:17.957618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:17.958086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:17.959667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:17.965641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 195/375] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:17.966621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:18.005017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44501d-f6a6-49bb-ada1-a2256fd6fa75 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:18.043660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:18.044499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.044809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.045068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:18.047088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:18.047794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:18.049852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 181/376] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:18.065810 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:18.066583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:18.100448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e258c86-db40-4ea3-9960-769f745822f7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:18.151764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:18.152879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.153301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.153772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] PATH_INFO: `/v3/projects/2a9104f36ddb422fa7bc883d1d00818c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:18.155143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] RBAC: Authorizing `identity:get_project(project_id=2a9104f36ddb422fa7bc883d1d00818c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:18.156770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:18.161081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:18.162743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 196/377] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:17 2022] GET /identity/v3/projects/2a9104f36ddb422fa7bc883d1d00818c => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:18.168852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:18.211761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5edb-3686-4d4a-a49b-e8882252b4ac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:18.275180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:18.275890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.276244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.276531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:18.277462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:18.277775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:18.279433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:18.285991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 182/378] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:18 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:18.335144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a449f5e-004d-443c-828a-b78a484d7bbb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:18.373128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410d002-cbb1-4888-9ea5-53e7b7274904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:18.374022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410d002-cbb1-4888-9ea5-53e7b7274904 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.374316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410d002-cbb1-4888-9ea5-53e7b7274904 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.374598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410d002-cbb1-4888-9ea5-53e7b7274904 None admin] PATH_INFO: `/v3/groups/5dba6769123242549345691926321581` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:18.388797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410d002-cbb1-4888-9ea5-53e7b7274904 None admin] RBAC: Authorizing `identity:get_group(group_id=5dba6769123242549345691926321581)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:18.388797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410d002-cbb1-4888-9ea5-53e7b7274904 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:18.392612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 197/379] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:18 2022] GET /identity/v3/groups/5dba6769123242549345691926321581 => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:18.398405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:18.536940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9a3fc-0e95-4b82-aec3-2786c35b9b70 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:18.581488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44937e45-0def-416d-a5d0-117d237cc645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:18.582597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44937e45-0def-416d-a5d0-117d237cc645 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.583086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44937e45-0def-416d-a5d0-117d237cc645 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.583540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44937e45-0def-416d-a5d0-117d237cc645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:18.584599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44937e45-0def-416d-a5d0-117d237cc645 None admin] RBAC: Adding query filter params (group.id=5dba6769123242549345691926321581, role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=2a9104f36ddb422fa7bc883d1d00818c) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:18.585101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44937e45-0def-416d-a5d0-117d237cc645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:18.587438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44937e45-0def-416d-a5d0-117d237cc645 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:18.589829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:18.598816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 183/380] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:18 2022] GET /identity/v3/role_assignments?group.id=5dba6769123242549345691926321581&scope.project.id=2a9104f36ddb422fa7bc883d1d00818c&role.id=296e3902a56444e692e58d5eb525a587 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:18.620991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f6f77-d637-4639-8a19-64fb1478581d None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.621578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f6f77-d637-4639-8a19-64fb1478581d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.622122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f6f77-d637-4639-8a19-64fb1478581d None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:18.623801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 198/381] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:18.630117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7613-dfe7-45e7-b6fd-f3bae37e1ec1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.630498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7613-dfe7-45e7-b6fd-f3bae37e1ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.630788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7613-dfe7-45e7-b6fd-f3bae37e1ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:18.658217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a7ef7613-dfe7-45e7-b6fd-f3bae37e1ec1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:18.659454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a7ef7613-dfe7-45e7-b6fd-f3bae37e1ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:18.758540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 184/382] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:18.794424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f6f77-d637-4639-8a19-64fb1478581d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:18.814792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:18.937892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f6f77-d637-4639-8a19-64fb1478581d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:18.984293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:18.985450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:18.985960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:18.986469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:19.001729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:19.010713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:19.011604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:19.012414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:19.018973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 199/383] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:19.025192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef7613-dfe7-45e7-b6fd-f3bae37e1ec1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:19.174008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef7613-dfe7-45e7-b6fd-f3bae37e1ec1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:19.210784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:19.220757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:19.221451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:19.221737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:19.222038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:19.222805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:19.223115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:19.224524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:19.237112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 185/384] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:19.243452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:19.390132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:19.437425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb15874-c28a-4422-bb7e-fd6aa71ea8b6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:19.483575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253695b-4aca-4e24-ae02-0aae3295f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:19.484354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253695b-4aca-4e24-ae02-0aae3295f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:19.484634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253695b-4aca-4e24-ae02-0aae3295f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:19.484903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253695b-4aca-4e24-ae02-0aae3295f0e3 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:19.486090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253695b-4aca-4e24-ae02-0aae3295f0e3 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:19.487601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253695b-4aca-4e24-ae02-0aae3295f0e3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:19.489552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 200/385] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:19 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:19.495424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:19.572388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e25c-902c-46d8-bd36-e1b19015e44b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:19.572710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e25c-902c-46d8-bd36-e1b19015e44b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:19.572953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e25c-902c-46d8-bd36-e1b19015e44b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:19.574517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 201/386] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:43:19.589806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b75b0-0fea-48ae-8778-f7c3e714bdd5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:19.590135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b75b0-0fea-48ae-8778-f7c3e714bdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:19.590367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b75b0-0fea-48ae-8778-f7c3e714bdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:19.622068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2c4b75b0-0fea-48ae-8778-f7c3e714bdd5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:19.623269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2c4b75b0-0fea-48ae-8778-f7c3e714bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:19.635078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57426ad-e916-4e50-a090-a40e33d380f9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:19.684165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:19.685035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:19.685317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:19.685592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:19.687226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:19.689112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:19.693785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 186/387] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:19 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:19.700213 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:19.753081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 202/388] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:19.785770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:19.795143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b75b0-0fea-48ae-8778-f7c3e714bdd5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:19.861255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288dda-f836-461e-bd4c-9596f0ce6135 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:19.913625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:19.924163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:19.925057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:19.925343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:19.925675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/groups/c6def0a994c540348d00e0dc9051455a/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:19.932292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb9343ccb7487ea8149ed0520905cb, group_id=c6def0a994c540348d00e0dc9051455a, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:19.933793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:19.956033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 187/389] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 3 09:43:19 2022] PUT /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/groups/c6def0a994c540348d00e0dc9051455a/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:19.976697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b75b0-0fea-48ae-8778-f7c3e714bdd5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:20.027372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:20.028129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:20.028417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:20.028694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:20.046283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:20.054726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:20.055713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:20.056515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 203/390] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:20.062306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:20.206959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05a8c3-301a-485b-aaac-e042bc427676 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:20.229186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:20.255925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:20.256620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:20.256907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:20.257188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:20.258815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:20.258815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:20.260248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:20.274435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 188/391] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:20.280002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:20.389434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba713-f679-4a0b-8f6c-093f4cf27986 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:20.419971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:20.427841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:20.428865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:20.429150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:20.429460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:20.431503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:20.433015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:20.435372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 204/392] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:20 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:20.441486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:20.602760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def287b-b2eb-421e-b7a4-8e5e4f34aa3d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:20.651429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eca74-522e-48cd-9a03-1ee62e2d4479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:20.652652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eca74-522e-48cd-9a03-1ee62e2d4479 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:20.653132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eca74-522e-48cd-9a03-1ee62e2d4479 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:20.653627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eca74-522e-48cd-9a03-1ee62e2d4479 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:20.658537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eca74-522e-48cd-9a03-1ee62e2d4479 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:20.660285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eca74-522e-48cd-9a03-1ee62e2d4479 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:20.662614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 189/393] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:20 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:20.669044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:20.805517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b42b-7012-43f5-b394-30b543de55a5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:20.842678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c8785-31bd-4930-8c58-818ffbe64b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:20.843794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c8785-31bd-4930-8c58-818ffbe64b7d None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:20.844218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c8785-31bd-4930-8c58-818ffbe64b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:20.844657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c8785-31bd-4930-8c58-818ffbe64b7d None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/groups/c6def0a994c540348d00e0dc9051455a/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:20.848831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c8785-31bd-4930-8c58-818ffbe64b7d None admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb9343ccb7487ea8149ed0520905cb, group_id=c6def0a994c540348d00e0dc9051455a, role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:20.850479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c8785-31bd-4930-8c58-818ffbe64b7d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:20.869348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 205/394] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 3 09:43:20 2022] PUT /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb/groups/c6def0a994c540348d00e0dc9051455a/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:20.962657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b31f60-c650-4f33-8e53-00226662c17e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:20.963336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b31f60-c650-4f33-8e53-00226662c17e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:20.963816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b31f60-c650-4f33-8e53-00226662c17e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:20.965678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 190/395] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:20.971379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592105-6999-426f-b44d-e397e6173af6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:20.971995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592105-6999-426f-b44d-e397e6173af6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:20.972491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592105-6999-426f-b44d-e397e6173af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:20.990963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-66592105-6999-426f-b44d-e397e6173af6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:20.993593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66592105-6999-426f-b44d-e397e6173af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:21.057913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:21.073691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 206/396] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:21.097080 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b31f60-c650-4f33-8e53-00226662c17e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:21.158016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:21.214165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b31f60-c650-4f33-8e53-00226662c17e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:21.251495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbcda3-3ec2-49e8-8675-44ca07e4b124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:21.252306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcda3-3ec2-49e8-8675-44ca07e4b124 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.252594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcda3-3ec2-49e8-8675-44ca07e4b124 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.252869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcda3-3ec2-49e8-8675-44ca07e4b124 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.268763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbcda3-3ec2-49e8-8675-44ca07e4b124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-dbcbcda3-3ec2-49e8-8675-44ca07e4b124 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:21.277119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:21.278072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:21.278876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:21.282471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 191/397] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:21.289064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66592105-6999-426f-b44d-e397e6173af6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:21.410876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849970c1-59b6-41b7-9ca7-d193f90c28a1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.411084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849970c1-59b6-41b7-9ca7-d193f90c28a1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.411530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849970c1-59b6-41b7-9ca7-d193f90c28a1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.413525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 192/398] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:21.418930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009264-9ab9-4902-80b8-1eac6cb5f33b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.419386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009264-9ab9-4902-80b8-1eac6cb5f33b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.419892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009264-9ab9-4902-80b8-1eac6cb5f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.432383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66592105-6999-426f-b44d-e397e6173af6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:21.438602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5f009264-9ab9-4902-80b8-1eac6cb5f33b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:21.440042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5f009264-9ab9-4902-80b8-1eac6cb5f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:21.480357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:21.481039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.481323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.481600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.482386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:21.482694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:21.484988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:21.501562 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 207/399] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:21.507391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:21.534947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 193/400] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:21.559125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009264-9ab9-4902-80b8-1eac6cb5f33b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:21.559609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:21.605186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:21.613393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032f80-0318-4d0b-8661-a79506ea0c09 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:21.649564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:21.650821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.651271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.651686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.653132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:21.654860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:21.657094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 208/401] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:21 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:21.662609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:21.672434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009264-9ab9-4902-80b8-1eac6cb5f33b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:21.709883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:21.710931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.711471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.711883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.723317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:21.732611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:21.733656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:21.734606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:21.736936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 194/402] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:21.743132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:21.771020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd61b3-4d5f-487c-941f-0f5e3831c466 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:21.790801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:21.814747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:21.815626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.815917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.816223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.822774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:21.824274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:21.827222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 209/403] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:21 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:21.832151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:21.855244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:21.860188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051bff3-c969-42d0-9596-30fb9926aa6e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:21.915021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:21.917818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:21.919043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:21.919520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:21.920653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:21.922086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:21.923836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:21.939477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 195/404] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:21.945118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:22.008493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916b4ce-2d9a-4551-940c-115f00fb2324 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:22.043218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:22.044364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.044791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.045215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/groups/c6def0a994c540348d00e0dc9051455a/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.047368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbc58f0cf944b9ac194be595d5b792, group_id=c6def0a994c540348d00e0dc9051455a, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:22.048953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:22.066199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 210/405] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 3 09:43:21 2022] PUT /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/groups/c6def0a994c540348d00e0dc9051455a/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:43:22.114339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a5d54-ea0b-4eee-b7fe-2c2cfe9390c1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:22.169509 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7d3e-a56e-428b-9582-6123b7e97e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:22.170334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7d3e-a56e-428b-9582-6123b7e97e83 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.170624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7d3e-a56e-428b-9582-6123b7e97e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.170973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7d3e-a56e-428b-9582-6123b7e97e83 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.172293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f7d3e-a56e-428b-9582-6123b7e97e83 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:22.173808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f7d3e-a56e-428b-9582-6123b7e97e83 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:22.175900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 196/406] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:21 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:22.181683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:22.216877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112692c6-bbc7-42d4-850c-69c2d52b90c8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.217455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112692c6-bbc7-42d4-850c-69c2d52b90c8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.217984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112692c6-bbc7-42d4-850c-69c2d52b90c8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.219922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 197/407] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:22.225621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbbef1-e19e-4082-9d9d-e1e0e6d6c0d0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.226229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbbef1-e19e-4082-9d9d-e1e0e6d6c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.226689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbbef1-e19e-4082-9d9d-e1e0e6d6c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.250217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f0fbbef1-e19e-4082-9d9d-e1e0e6d6c0d0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:22.253574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f0fbbef1-e19e-4082-9d9d-e1e0e6d6c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:22.269515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:22.303030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:22.369441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03307cfa-2470-4d1e-a616-fb2a523e4721 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:22.380089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 198/408] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:22.411769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbbef1-e19e-4082-9d9d-e1e0e6d6c0d0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:22.419950 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:22.420756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.421044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.421325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.422532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:22.423991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:22.425732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 211/409] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:22 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:22.434833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:22.574237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd2b84-3bd7-4e97-b436-b3c38c5c70ad None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:22.609098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:22.652231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbbef1-e19e-4082-9d9d-e1e0e6d6c0d0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:22.681953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:22.683094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.683567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.683991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/groups/c6def0a994c540348d00e0dc9051455a/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.686464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbc58f0cf944b9ac194be595d5b792, group_id=c6def0a994c540348d00e0dc9051455a, role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:22.688127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:22.716580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 212/410] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 3 09:43:22 2022] PUT /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792/groups/c6def0a994c540348d00e0dc9051455a/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:22.722627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:22.723683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.724113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.724538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.743739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:22.751800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:22.752851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:22.753902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:22.756185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 199/411] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:22.762966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:22.915697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77947-8b5e-46bb-88c9-392d01638cb0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:22.965166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111940a-3b06-427f-b6ea-ddade402983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:22.965888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111940a-3b06-427f-b6ea-ddade402983f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:22.966172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111940a-3b06-427f-b6ea-ddade402983f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:22.966449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111940a-3b06-427f-b6ea-ddade402983f None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:22.967214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111940a-3b06-427f-b6ea-ddade402983f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:22.967517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111940a-3b06-427f-b6ea-ddade402983f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:22.968992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111940a-3b06-427f-b6ea-ddade402983f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:22.978729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 213/412] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:22.985085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:23.019870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205f4f-7242-441a-b8ab-498aec365353 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.020409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205f4f-7242-441a-b8ab-498aec365353 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.020409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205f4f-7242-441a-b8ab-498aec365353 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:23.022218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 214/413] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:43:23.023078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:23.031224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6de090-f536-469f-bea7-ab90ae1ac7d4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.031524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6de090-f536-469f-bea7-ab90ae1ac7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.031799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6de090-f536-469f-bea7-ab90ae1ac7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:23.065526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ce6de090-f536-469f-bea7-ab90ae1ac7d4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:23.066755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ce6de090-f536-469f-bea7-ab90ae1ac7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:23.119073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:23.127480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c238fb-7bb9-4e13-97cb-53c41d2e32f4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:23.172741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:23.175161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.175814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.176280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] PATH_INFO: `/v3/groups/5dba6769123242549345691926321581` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:23.178481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] RBAC: Authorizing `identity:get_group(group_id=5dba6769123242549345691926321581)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:23.180582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:23.183072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 200/414] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:22 2022] GET /identity/v3/groups/5dba6769123242549345691926321581 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:23.190459 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:23.198036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 215/415] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:23.241868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6de090-f536-469f-bea7-ab90ae1ac7d4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:23.322129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:23.342371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07954a-b872-4e07-801a-287eac3a613f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:23.429058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:23.432878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.433186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.433473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] PATH_INFO: `/v3/projects/2a9104f36ddb422fa7bc883d1d00818c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:23.436659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] RBAC: Authorizing `identity:get_project(project_id=2a9104f36ddb422fa7bc883d1d00818c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:23.438158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:23.441920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 201/416] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:23 2022] GET /identity/v3/projects/2a9104f36ddb422fa7bc883d1d00818c => generated 344 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:23.453131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:23.461929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6de090-f536-469f-bea7-ab90ae1ac7d4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:23.527175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:23.528026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.528378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.528716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:23.554624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:23.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:23.564627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:23.566680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:23.574998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 216/417] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:23.576501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:23.634650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1050e-3ef0-4b32-a592-9a13c079dbba None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:23.643419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:23.727517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:23.728574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.728869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.729154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] PATH_INFO: `/v3/projects/2a9104f36ddb422fa7bc883d1d00818c/groups/5dba6769123242549345691926321581/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:23.732091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a9104f36ddb422fa7bc883d1d00818c, group_id=5dba6769123242549345691926321581, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:23.734848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:23.741813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1785897-7ceb-42d5-8a6c-d63593523efd None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:23.760078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 202/418] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Jun 3 09:43:23 2022] PUT /identity/v3/projects/2a9104f36ddb422fa7bc883d1d00818c/groups/5dba6769123242549345691926321581/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:23.795541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecce3e-4c2c-4e24-af4b-3c23d72c5fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:23.796527 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecce3e-4c2c-4e24-af4b-3c23d72c5fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.796957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecce3e-4c2c-4e24-af4b-3c23d72c5fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.797379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecce3e-4c2c-4e24-af4b-3c23d72c5fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:23.798616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecce3e-4c2c-4e24-af4b-3c23d72c5fe9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:23.799130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecce3e-4c2c-4e24-af4b-3c23d72c5fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:23.800963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecce3e-4c2c-4e24-af4b-3c23d72c5fe9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:23.813934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 217/419] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:23.823014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:23.858204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:23.951003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f4164-1626-42d9-aaa1-4ab6fa9157c8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:23.989441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:23.990373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:23.990804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:23.991263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.004041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464d0ec-25d8-4d2a-8754-551e8fd8f9e5 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.004563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464d0ec-25d8-4d2a-8754-551e8fd8f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.004987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464d0ec-25d8-4d2a-8754-551e8fd8f9e5 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.007023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 218/420] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:24.019142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd430d3-46e3-42ae-9754-1b5696b8c83b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.020118 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd430d3-46e3-42ae-9754-1b5696b8c83b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.021045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd430d3-46e3-42ae-9754-1b5696b8c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.052900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ebd430d3-46e3-42ae-9754-1b5696b8c83b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:24.054412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ebd430d3-46e3-42ae-9754-1b5696b8c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:24.073505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:24.075041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:24.093456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:24.147856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 219/421] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:24.176288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd430d3-46e3-42ae-9754-1b5696b8c83b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:24.203358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:24.227325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 203/422] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:24.234451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:24.380835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd430d3-46e3-42ae-9754-1b5696b8c83b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:24.404144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385640b-9724-4cb3-8cf3-ffef98de3cd5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:24.426151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:24.448993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:24.449845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.450129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.450402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.467952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:24.470569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:24.471437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.471714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.471987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.474025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:24.475475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:24.477351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 204/423] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:24 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:24.487459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:24.488383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:24.489154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 220/424] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:24.490365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:24.500780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:24.627618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f37695-e636-4a1c-a2b6-ef5cef330db1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:24.669940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:24.670721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.671006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.671279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.672508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:24.673973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:24.675589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 205/425] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:24 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:24.680345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:24.681797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:24.718944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c44d-c3b4-4397-837b-024d8de8976e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:24.746137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:24.780414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7cef2-d904-4b02-8acf-caa0aed872dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:24.781413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7cef2-d904-4b02-8acf-caa0aed872dc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.781935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7cef2-d904-4b02-8acf-caa0aed872dc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.782384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7cef2-d904-4b02-8acf-caa0aed872dc None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.783450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7cef2-d904-4b02-8acf-caa0aed872dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:24.783956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7cef2-d904-4b02-8acf-caa0aed872dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:24.785724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7cef2-d904-4b02-8acf-caa0aed872dc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:24.785946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c2299-b07f-48c1-9e8f-3fa68345e71c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:24.796798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 221/426] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:24.798583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e403e2-beb8-44ad-ac64-685cf46c0b62 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.799086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e403e2-beb8-44ad-ac64-685cf46c0b62 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.799563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e403e2-beb8-44ad-ac64-685cf46c0b62 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.805366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 222/427] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:24.806501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e403e2-beb8-44ad-ac64-685cf46c0b62 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:24.824436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fd45e-d1e7-4043-946f-f511a2a2773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:24.825094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fd45e-d1e7-4043-946f-f511a2a2773d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.825376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fd45e-d1e7-4043-946f-f511a2a2773d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.825653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fd45e-d1e7-4043-946f-f511a2a2773d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.826536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fd45e-d1e7-4043-946f-f511a2a2773d None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:24.826847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fd45e-d1e7-4043-946f-f511a2a2773d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:24.828418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fd45e-d1e7-4043-946f-f511a2a2773d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:24.841619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 206/428] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:24 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:24.841619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae74d-21be-4e7a-966f-3530c80c7da8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:24.841619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae74d-21be-4e7a-966f-3530c80c7da8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:24.841619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae74d-21be-4e7a-966f-3530c80c7da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:24.855333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-216ae74d-21be-4e7a-966f-3530c80c7da8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:24.856537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-216ae74d-21be-4e7a-966f-3530c80c7da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:24.931363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 207/429] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:24.967583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae74d-21be-4e7a-966f-3530c80c7da8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:24.983719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e403e2-beb8-44ad-ac64-685cf46c0b62 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.049673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.050465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.050650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.050907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.051338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.071574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.158773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:25.160200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:25.161247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae74d-21be-4e7a-966f-3530c80c7da8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.219568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.220758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.221306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.221999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.236788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:25.247683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:25.248633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 09:43:25.249463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:25.252408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 208/430] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:25.258381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:25.272974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 223/431] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:25.278869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:25.333799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.402676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941e8b3-175b-4661-aace-e99ba30a8660 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.405623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.414772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d8e6a-70b5-420d-bcd8-03a6090461be None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.441968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.442646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.442935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.443209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.443955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:25.445948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:25.448174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:25.458820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.459276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 209/432] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:25.459675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.459955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.460227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] PATH_INFO: `/v3/projects/8ceb9343ccb7487ea8149ed0520905cb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.461503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] RBAC: Authorizing `identity:get_project(project_id=8ceb9343ccb7487ea8149ed0520905cb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:25.462982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:25.465111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 224/433] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:25 2022] GET /identity/v3/projects/8ceb9343ccb7487ea8149ed0520905cb => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:25.466484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:25.471165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:25.578106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45132525-af7e-49af-8c80-7916d93da114 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.588182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480330e-7840-4f7d-840f-32fd29f0f82d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.598014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.613773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bfc66-154f-4ca7-93c9-a52e05ce2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.614432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bfc66-154f-4ca7-93c9-a52e05ce2210 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.614720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bfc66-154f-4ca7-93c9-a52e05ce2210 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.614999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bfc66-154f-4ca7-93c9-a52e05ce2210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.626781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.627638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.627929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.628211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.629402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:25.630891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:25.632977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 225/434] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:25 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:25.638542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:25.651250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.700109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bfc66-154f-4ca7-93c9-a52e05ce2210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:25.701576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bfc66-154f-4ca7-93c9-a52e05ce2210 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:25.776287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53045d9d-5dad-41a2-9171-9e88f1c121a7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.810904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47522-2db2-4664-af8c-fa4add733c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.811563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47522-2db2-4664-af8c-fa4add733c70 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.812082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47522-2db2-4664-af8c-fa4add733c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.812200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 210/435] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:25.812279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47522-2db2-4664-af8c-fa4add733c70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.813100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47522-2db2-4664-af8c-fa4add733c70 None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=8ceb9343ccb7487ea8149ed0520905cb) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:25.813326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf1c3-0385-48ca-a511-8ebd2ff616ab None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.813419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47522-2db2-4664-af8c-fa4add733c70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:25.813620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf1c3-0385-48ca-a511-8ebd2ff616ab None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.813921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf1c3-0385-48ca-a511-8ebd2ff616ab None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.814915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47522-2db2-4664-af8c-fa4add733c70 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:25.815304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 211/436] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:25.818787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf1c3-0385-48ca-a511-8ebd2ff616ab None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:25.822187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 226/437] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:25 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=8ceb9343ccb7487ea8149ed0520905cb&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:25.827217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006f164-8331-4aa2-85f8-5814f39c8d66 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:25.827517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006f164-8331-4aa2-85f8-5814f39c8d66 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:25.827790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006f164-8331-4aa2-85f8-5814f39c8d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:25.852055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1006f164-8331-4aa2-85f8-5814f39c8d66 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:25.854071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1006f164-8331-4aa2-85f8-5814f39c8d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:25.905268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.909204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:25.954646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf1c3-0385-48ca-a511-8ebd2ff616ab None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:25.955682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 227/438] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:25.979836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006f164-8331-4aa2-85f8-5814f39c8d66 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:25.998089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:25.999578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.000492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.000978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.002520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:26.005212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:26.009174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 212/439] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:25 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:26.017881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.103490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006f164-8331-4aa2-85f8-5814f39c8d66 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.146500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf419ba0-e088-4a29-abea-fbcf94a9ecc0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.149118 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.150267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.150712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.151134 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.167677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:26.176806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:26.177706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:26.178552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:26.181473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 228/440] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:26.184603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.198369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.200234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.200528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.203197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.206900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:26.209565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:26.213511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 213/441] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:26.219411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.223797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:26.228691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:26.322971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff7bd-3bbb-4df9-aab3-77f65c0d9102 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.360530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a59f8-7c00-43db-8164-3db0aea97fb2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.368330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.369414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.369706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.370020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.371151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:26.371469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:26.373184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:26.382669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 229/442] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:26.390152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.402367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4674c7b-144e-43cb-b544-b23b31041b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.403033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4674c7b-144e-43cb-b544-b23b31041b86 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.403319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4674c7b-144e-43cb-b544-b23b31041b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.403607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4674c7b-144e-43cb-b544-b23b31041b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.404456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4674c7b-144e-43cb-b544-b23b31041b86 None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=ad92bcd216834a4d94b428c07289fd02, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:26.404757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4674c7b-144e-43cb-b544-b23b31041b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:26.406259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4674c7b-144e-43cb-b544-b23b31041b86 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:26.412412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 214/443] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=ad92bcd216834a4d94b428c07289fd02 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:26.468792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83636a9-5554-47fe-ba3d-909e53104207 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.469078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83636a9-5554-47fe-ba3d-909e53104207 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.469359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83636a9-5554-47fe-ba3d-909e53104207 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.471265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 215/444] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:43:26.477572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f985-1084-4f89-b761-8a20fd4a39a8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.477893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f985-1084-4f89-b761-8a20fd4a39a8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.478173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f985-1084-4f89-b761-8a20fd4a39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.495794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6796f985-1084-4f89-b761-8a20fd4a39a8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:26.497047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6796f985-1084-4f89-b761-8a20fd4a39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:26.497812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:26.508947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73665a-2a2a-44b7-8d3f-80e9a618c08a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.548092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.548758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.549045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.549324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.561313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:26.582186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 216/445] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:26.601149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f985-1084-4f89-b761-8a20fd4a39a8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.637672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:26.639532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:26.723094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f985-1084-4f89-b761-8a20fd4a39a8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.742760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:26.755688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 230/446] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:43:26.761516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.764032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.765563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.765563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.765727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.777009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:26.784675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:26.785570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:26.786413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 217/447] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:26.793464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.857738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:26.868175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa4145-642e-49fe-a118-68fe6ad69acf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.901534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1ea87-18d7-4a0a-9894-5d78ffbc4ef7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:26.902343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.903197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.903483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.903769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] PATH_INFO: `/v3/projects/c0cbc58f0cf944b9ac194be595d5b792` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.904951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbc58f0cf944b9ac194be595d5b792)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:26.906437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:26.908286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 231/448] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/projects/c0cbc58f0cf944b9ac194be595d5b792 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:26.913549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.934407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:26.935068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:26.935353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:26.935628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:26.936365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:26.936668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:26.938049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:26.946523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 218/449] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:26.951854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:26.972415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:27.013282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270f02f-15a3-4084-87f1-99c30a983af0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:27.046624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:27.047374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbb737-c0bb-477d-bc76-dc7e7fe6837a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:27.047479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:27.047726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:27.048000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] PATH_INFO: `/v3/groups/c6def0a994c540348d00e0dc9051455a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:27.049156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] RBAC: Authorizing `identity:get_group(group_id=c6def0a994c540348d00e0dc9051455a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:27.050619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:27.052204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 232/450] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/groups/c6def0a994c540348d00e0dc9051455a => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:27.057902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:27.064271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:27.082022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:27.082667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:27.082953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:27.083230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:27.150425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:27.151941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:27.154198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f0d-627d-42a7-b4c9-db1cd8c7adc8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:27.180062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:27.188258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:27.188911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:27.189197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:27.189484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:27.190360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] RBAC: Adding query filter params (group.id=c6def0a994c540348d00e0dc9051455a, role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=c0cbc58f0cf944b9ac194be595d5b792) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:27.190679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:27.193057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:27.199379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 233/451] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:27 2022] GET /identity/v3/role_assignments?group.id=c6def0a994c540348d00e0dc9051455a&scope.project.id=c0cbc58f0cf944b9ac194be595d5b792&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:27.253305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 219/452] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:43:27.259667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:27.362362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa73f-0ae9-4b91-93ff-100bec49ee35 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:27.401171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:27.402182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:27.402405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:27.402683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] PATH_INFO: `/v3/projects/2a9104f36ddb422fa7bc883d1d00818c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:27.403846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] RBAC: Authorizing `identity:get_project(project_id=2a9104f36ddb422fa7bc883d1d00818c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:27.405273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:27.407188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 234/453] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:43:27 2022] GET /identity/v3/projects/2a9104f36ddb422fa7bc883d1d00818c => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:27.412455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:27.431447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:27.512854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14bdeb-b1ef-495c-a23c-1e39bf939d75 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:27.547108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ec61-cd74-4191-a97e-f6edee9768f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:27.547963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ec61-cd74-4191-a97e-f6edee9768f0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:27.548243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ec61-cd74-4191-a97e-f6edee9768f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:27.548521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ec61-cd74-4191-a97e-f6edee9768f0 None admin] PATH_INFO: `/v3/groups/5dba6769123242549345691926321581` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:27.549672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ec61-cd74-4191-a97e-f6edee9768f0 None admin] RBAC: Authorizing `identity:get_group(group_id=5dba6769123242549345691926321581)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:27.551184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ec61-cd74-4191-a97e-f6edee9768f0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:27.552783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 220/454] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Jun 3 09:43:27 2022] GET /identity/v3/groups/5dba6769123242549345691926321581 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:27.559104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:27.618979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:27.660572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71a568-723b-4883-993d-558c6f4bf89d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:27.692520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbf0dc-cf7b-4910-9d9a-b594a3ce1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:27.693157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbf0dc-cf7b-4910-9d9a-b594a3ce1959 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:27.693443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbf0dc-cf7b-4910-9d9a-b594a3ce1959 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:27.693721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbf0dc-cf7b-4910-9d9a-b594a3ce1959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:27.694571 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbf0dc-cf7b-4910-9d9a-b594a3ce1959 None admin] RBAC: Adding query filter params (group.id=5dba6769123242549345691926321581, role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=2a9104f36ddb422fa7bc883d1d00818c) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:27.694884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbf0dc-cf7b-4910-9d9a-b594a3ce1959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:27.696819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbf0dc-cf7b-4910-9d9a-b594a3ce1959 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:27.702531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 235/455] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Jun 3 09:43:27 2022] GET /identity/v3/role_assignments?group.id=5dba6769123242549345691926321581&scope.project.id=2a9104f36ddb422fa7bc883d1d00818c&role.id=296e3902a56444e692e58d5eb525a587 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:30.559927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada5ca-1322-4b64-bfdf-a7dbee2b9178 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:30.560964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada5ca-1322-4b64-bfdf-a7dbee2b9178 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:30.561461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada5ca-1322-4b64-bfdf-a7dbee2b9178 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:30.563384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 221/456] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:30.568416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e4c9-c41b-49f5-b273-c3b60e759d30 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:30.569269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e4c9-c41b-49f5-b273-c3b60e759d30 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:30.569800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e4c9-c41b-49f5-b273-c3b60e759d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:30.577056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b548-c320-45b1-b310-cc53833b3cb7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:30.577618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b548-c320-45b1-b310-cc53833b3cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:30.578134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b548-c320-45b1-b310-cc53833b3cb7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:30.579989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 222/457] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:43:30.584865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8fa4-edf4-4ce5-a6b5-5e7043eec57b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:30.585153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8fa4-edf4-4ce5-a6b5-5e7043eec57b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:30.585433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8fa4-edf4-4ce5-a6b5-5e7043eec57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:30.599494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f8b3e4c9-c41b-49f5-b273-c3b60e759d30 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:30.601024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f8b3e4c9-c41b-49f5-b273-c3b60e759d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:30.614741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-704e8fa4-edf4-4ce5-a6b5-5e7043eec57b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:30.615925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-704e8fa4-edf4-4ce5-a6b5-5e7043eec57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:30.714425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 236/458] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:30.715941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216776be-36e8-4724-803f-266451a9312e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:30.716240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216776be-36e8-4724-803f-266451a9312e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:30.716524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216776be-36e8-4724-803f-266451a9312e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:30.717923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 237/459] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:30.723514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684ae42-0ac8-4eb7-ba78-39dd64ca085b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:30.724007 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684ae42-0ac8-4eb7-ba78-39dd64ca085b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:30.724716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684ae42-0ac8-4eb7-ba78-39dd64ca085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:30.741019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 223/460] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:30.742121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8fa4-edf4-4ce5-a6b5-5e7043eec57b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:30.753776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4684ae42-0ac8-4eb7-ba78-39dd64ca085b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:30.753776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4684ae42-0ac8-4eb7-ba78-39dd64ca085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:30.774714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:30.819445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:30.847882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 238/461] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:30.848742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684ae42-0ac8-4eb7-ba78-39dd64ca085b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:30.882200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8fa4-edf4-4ce5-a6b5-5e7043eec57b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:30.934297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:30.935374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:30.935802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:30.936254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:30.947552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:30.949225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:30.968713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:30.969788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:30.970789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:30.970789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:30.970789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:30.970789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:30.977030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 224/462] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:30.977160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684ae42-0ac8-4eb7-ba78-39dd64ca085b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:30.978175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.015384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.015610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.015820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.016098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.029333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.030954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:31.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:31.052154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:31.053138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:31.053138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:31.053138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:31.053138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:31.057579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 239/463] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:31.058463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:31.059733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.090286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10819a28-14c9-4267-bc7c-8b845e0ceb3d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.098180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:31.128074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.128868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.129390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.129534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.140942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.142481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:31.161538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:31.162611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:31.163663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:31.163663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:31.163663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:31.163663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:31.163663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 225/464] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:31.163663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.174549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626219-6fe9-4d18-89bf-515c523cf5e7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.216712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.217637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.218093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.218515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.219582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:31.220091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.221639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.235204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 240/465] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:31.236263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.293477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ace0-5bcd-44b0-a467-7c604e4ed721 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.323163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:31.345673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.346421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.346921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.347208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.348143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:31.348404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.349951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.359840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:31.366321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6935-20da-4dde-94fb-039b0317a069 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.370889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 226/466] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:31.371847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.411917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47caa-47a0-49d3-9d2c-5849fb13a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.412581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47caa-47a0-49d3-9d2c-5849fb13a81a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.412868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47caa-47a0-49d3-9d2c-5849fb13a81a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.413150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47caa-47a0-49d3-9d2c-5849fb13a81a None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.413916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47caa-47a0-49d3-9d2c-5849fb13a81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:31.414795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47caa-47a0-49d3-9d2c-5849fb13a81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.416168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47caa-47a0-49d3-9d2c-5849fb13a81a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.428692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 241/467] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:31.429834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d0b6b-b1e5-44cd-a234-c142e2a96fc9 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.430133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d0b6b-b1e5-44cd-a234-c142e2a96fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.430418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d0b6b-b1e5-44cd-a234-c142e2a96fc9 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.433791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 242/468] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:31.433791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d0b6b-b1e5-44cd-a234-c142e2a96fc9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.485303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ad15-d0b6-4b97-93cd-e93d8740c4d3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.522490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.523170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.523489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.524399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.525117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.526591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.543412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d0b6b-b1e5-44cd-a234-c142e2a96fc9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.546906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 227/469] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:43:31 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:31.547522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.602702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893673-8b11-44ab-9d82-292c7dc0ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.604281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893673-8b11-44ab-9d82-292c7dc0ab72 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.604783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893673-8b11-44ab-9d82-292c7dc0ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.605167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893673-8b11-44ab-9d82-292c7dc0ab72 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.606049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893673-8b11-44ab-9d82-292c7dc0ab72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.607850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893673-8b11-44ab-9d82-292c7dc0ab72 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.612051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:31.635475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 243/470] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:43:31 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:31.643666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f793-b9d3-45cb-8cc0-6a7b1c0fccce None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.644142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f793-b9d3-45cb-8cc0-6a7b1c0fccce None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.644524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f793-b9d3-45cb-8cc0-6a7b1c0fccce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.666233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-43d0f793-b9d3-45cb-8cc0-6a7b1c0fccce None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:31.667511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-43d0f793-b9d3-45cb-8cc0-6a7b1c0fccce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:31.676343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:31.701204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e4248-38ad-4d94-8bb1-444006d930c6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.742971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.743959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.744395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.744823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.745702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.747441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:31.762569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 244/471] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:31.764132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7276-4e0d-4a4f-baa4-5090015e7f2e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.764553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7276-4e0d-4a4f-baa4-5090015e7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.764939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7276-4e0d-4a4f-baa4-5090015e7f2e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.771865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 245/472] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:31.774222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a0df-4cbb-4b18-a09c-60275bce9be8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.774554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 228/473] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:43:31 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:31.774794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a0df-4cbb-4b18-a09c-60275bce9be8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.775230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a0df-4cbb-4b18-a09c-60275bce9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.795825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1031a0df-4cbb-4b18-a09c-60275bce9be8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:31.797385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1031a0df-4cbb-4b18-a09c-60275bce9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:31.798699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.885328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 246/474] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:31.909439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031a0df-4cbb-4b18-a09c-60275bce9be8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:31.913725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:31.925047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f73b-b3f3-463d-bbfd-c81484d99001 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:31.966292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:31.967972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:31.967972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:31.968337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:31.985178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:31.986095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:32.002905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:32.007095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:32.008578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:32.009582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:32.009582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:32.009582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:32.009582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:32.009582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 229/475] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:32.014768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:32.046315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031a0df-4cbb-4b18-a09c-60275bce9be8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:32.090817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:32.091597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:32.091889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:32.092169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:32.093051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:32.094476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:32.101445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.sql.core [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 09:43:32.101445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 09:43:32.101445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [parameters: {'id': 'a6ac1e26a3cd4cdd9bc1fde64a62ae27', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 09:43:32.101445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() Jun 03 09:43:32.119402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return ref.to_dict() Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 09:43:32.120363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application yield resource Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise self.value Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application session.commit() Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 09:43:32.121292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.flush() Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application compat.raise_( Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 09:43:32.122191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 09:43:32.123090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 09:43:32.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [parameters: {'id': 'a6ac1e26a3cd4cdd9bc1fde64a62ae27', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:32.124659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 09:43:32.125448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:32.128373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 247/476] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 3 09:43:31 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:32.128373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:32.152275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637c1d-3723-4147-82ee-cb6551fec12f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:32.207133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:32.208175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:32.209893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:32.211643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:32.212552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:32.213898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:32.215483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:32.248378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 230/477] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:32.258658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1d4e-45a0-4840-9600-e42bf05620ea None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:32.258803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:32.277850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:32.303629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:32.304454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:32.307345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:32.307650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:32.314105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:32.332987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:32.342327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:32.343414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:32.344480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 248/478] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:43:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:32.349173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:32.474674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bdaff-5dcc-4ce4-b2cd-e29dc71dcd8e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:32.496147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0008b-92b3-4a59-b90a-0a64140ffa5d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:32.602677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e79f8e-d442-44c6-ad2f-bfdd6f4138d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:32.603609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e79f8e-d442-44c6-ad2f-bfdd6f4138d4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:32.604469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e79f8e-d442-44c6-ad2f-bfdd6f4138d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:32.604891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e79f8e-d442-44c6-ad2f-bfdd6f4138d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:32.605864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e79f8e-d442-44c6-ad2f-bfdd6f4138d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:32.606320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e79f8e-d442-44c6-ad2f-bfdd6f4138d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:32.607857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e79f8e-d442-44c6-ad2f-bfdd6f4138d4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:32.616979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 249/479] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:32.687533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b3285-914d-41da-a31e-19be5f592492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:32.688873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b3285-914d-41da-a31e-19be5f592492 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:32.689313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b3285-914d-41da-a31e-19be5f592492 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:32.689868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b3285-914d-41da-a31e-19be5f592492 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:32.690773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b3285-914d-41da-a31e-19be5f592492 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:32.692444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b3285-914d-41da-a31e-19be5f592492 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:32.733198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 231/480] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:43:32 2022] POST /identity/v3/users => generated 249 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:34.398246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358e17-ba41-40aa-9ecf-fd114869e0bd None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:34.399140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358e17-ba41-40aa-9ecf-fd114869e0bd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:34.399630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358e17-ba41-40aa-9ecf-fd114869e0bd None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:34.401454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 250/481] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:34.406406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac62aa-3610-4ddc-bba4-a227c5cdd1fe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:34.407228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac62aa-3610-4ddc-bba4-a227c5cdd1fe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:34.407716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac62aa-3610-4ddc-bba4-a227c5cdd1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:34.430234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-35ac62aa-3610-4ddc-bba4-a227c5cdd1fe None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:34.431750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-35ac62aa-3610-4ddc-bba4-a227c5cdd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:34.501583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:34.522197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 232/482] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:34.557969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70358e17-ba41-40aa-9ecf-fd114869e0bd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:34.645831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:34.655319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd6a1-b75a-4af6-ac6a-f46a3baac390 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:34.655825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd6a1-b75a-4af6-ac6a-f46a3baac390 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:34.656282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd6a1-b75a-4af6-ac6a-f46a3baac390 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:34.658472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 233/483] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:34.664159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa7b7-43cb-4d24-812a-1a0010d204ee None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:34.664450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa7b7-43cb-4d24-812a-1a0010d204ee None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:34.664723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa7b7-43cb-4d24-812a-1a0010d204ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:34.743872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f52fa7b7-43cb-4d24-812a-1a0010d204ee None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:34.744427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f52fa7b7-43cb-4d24-812a-1a0010d204ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:34.806101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70358e17-ba41-40aa-9ecf-fd114869e0bd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:34.928477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:34.929213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:34.929500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:34.930354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:34.946186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 234/484] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:34.948082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235e5d9-7eef-4792-ab1a-7c7c4c906e6a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:34.948442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235e5d9-7eef-4792-ab1a-7c7c4c906e6a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:34.948795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235e5d9-7eef-4792-ab1a-7c7c4c906e6a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:34.952519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 235/485] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:34.959654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d6d6-2463-473d-affe-caff530725a8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:34.959654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d6d6-2463-473d-affe-caff530725a8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:34.959654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d6d6-2463-473d-affe-caff530725a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:34.969425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:34.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:34.978740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:34.979546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:34.981971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 251/486] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:34.983435 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.012761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d4f2d6d6-2463-473d-affe-caff530725a8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:35.014000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d4f2d6d6-2463-473d-affe-caff530725a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:35.157881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 236/487] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:35.157881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d6d6-2463-473d-affe-caff530725a8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.184352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fed085-bef3-40c7-b3ee-38d4839bab69 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.207827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:35.225820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:35.232845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.233668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.233989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.234263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.246658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:35.254615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:35.255596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:35.256405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:35.262165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 252/488] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:35.263096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.296817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d6d6-2463-473d-affe-caff530725a8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.342258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.343628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.344133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.344591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.345920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:35.346414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:35.348558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:35.364038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 237/489] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:35.364038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.375646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96815fa-2a18-49ed-961e-a97512baf508 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.428712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.430947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.431384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.431807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.447165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:35.458010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:35.459148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:35.460156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:35.463555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 253/490] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:35.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.496151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2b3f2-a2ca-4b41-948c-070dd2537cbc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.507317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:35.509865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:35.532009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e936a1-db87-45b5-a8e9-0b0e2bb4d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.532679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e936a1-db87-45b5-a8e9-0b0e2bb4d45d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.532969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e936a1-db87-45b5-a8e9-0b0e2bb4d45d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.533251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e936a1-db87-45b5-a8e9-0b0e2bb4d45d None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.534030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e936a1-db87-45b5-a8e9-0b0e2bb4d45d None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:35.534345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e936a1-db87-45b5-a8e9-0b0e2bb4d45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:35.535750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e936a1-db87-45b5-a8e9-0b0e2bb4d45d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:35.543970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 238/491] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:35.545200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06f15c-8caf-4d80-8073-4a697c02aa98 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.545496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06f15c-8caf-4d80-8073-4a697c02aa98 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.545802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06f15c-8caf-4d80-8073-4a697c02aa98 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.547210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 239/492] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:35.547726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06f15c-8caf-4d80-8073-4a697c02aa98 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.577440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb7cc4-f814-4144-b42b-c1b3afcfb101 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.609720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47a366-0e40-4f4a-8a8b-3781b7f40c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.610535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a366-0e40-4f4a-8a8b-3781b7f40c12 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.610826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a366-0e40-4f4a-8a8b-3781b7f40c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.611108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a366-0e40-4f4a-8a8b-3781b7f40c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.622230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47a366-0e40-4f4a-8a8b-3781b7f40c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:35.623695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47a366-0e40-4f4a-8a8b-3781b7f40c12 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7c47a366-0e40-4f4a-8a8b-3781b7f40c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:35.641722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:35.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:35.643889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:35.643889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:35.643889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:35.643889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:35.643889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 254/493] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:35.644198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da191-6fff-4097-8dc8-675cd5386e66 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.644415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da191-6fff-4097-8dc8-675cd5386e66 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.644724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da191-6fff-4097-8dc8-675cd5386e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.660771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-932da191-6fff-4097-8dc8-675cd5386e66 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:35.661972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-932da191-6fff-4097-8dc8-675cd5386e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:35.662072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06f15c-8caf-4d80-8073-4a697c02aa98 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.695123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.696354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.696639 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.696918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.697717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:35.698011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:35.699384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:35.707113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 240/494] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:35.707883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.731691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 255/495] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:35.733307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c81040-4ed5-4159-8e5d-0bdf6c6583e9 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.733601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c81040-4ed5-4159-8e5d-0bdf6c6583e9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.733918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c81040-4ed5-4159-8e5d-0bdf6c6583e9 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.735221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 256/496] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:35.735901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c81040-4ed5-4159-8e5d-0bdf6c6583e9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.759027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:35.760454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:35.824343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede49c-12bc-4ae1-931c-f16d86799e28 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.838643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c81040-4ed5-4159-8e5d-0bdf6c6583e9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:35.857348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03092e9a-dcf1-45ef-9d86-ae0f80138ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.858153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092e9a-dcf1-45ef-9d86-ae0f80138ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.858443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092e9a-dcf1-45ef-9d86-ae0f80138ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.858721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092e9a-dcf1-45ef-9d86-ae0f80138ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.869320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03092e9a-dcf1-45ef-9d86-ae0f80138ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:35.870793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03092e9a-dcf1-45ef-9d86-ae0f80138ae5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:35.872013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:35.872662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.872943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.873222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.873960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:35.874264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:35.875606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:35.886928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 257/497] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:35.887699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-03092e9a-dcf1-45ef-9d86-ae0f80138ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:35.887963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:35.888790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:35.889622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:35.889622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:35.889622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:35.889622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:35.889622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 241/498] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:35.890306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5ed4-389f-48fa-aa67-363543a1dcb8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:35.890591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5ed4-389f-48fa-aa67-363543a1dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:35.890870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5ed4-389f-48fa-aa67-363543a1dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:35.907424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9a1b5ed4-389f-48fa-aa67-363543a1dcb8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:35.908659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a1b5ed4-389f-48fa-aa67-363543a1dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:35.971375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:35.974017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 242/499] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:35.974855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b5ed4-389f-48fa-aa67-363543a1dcb8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:35.993187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.003512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc297f-3f63-4ca1-a8d8-90dd79e2b868 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.037979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.038765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.039076 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.039349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.073379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b5ed4-389f-48fa-aa67-363543a1dcb8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.109206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.110050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.110335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.110608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.121719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.123242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:36.142114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:36.143190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:36.144099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:36.144099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:36.144099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:36.144099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:36.144099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 243/500] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:36.144366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.169532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.171005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:36.188180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:36.189254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:36.190152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:36.190152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:36.190152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:36.190152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:36.190152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 258/501] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:36.190152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.218966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.253029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322e056-0681-46ab-b5e5-33b687e23e39 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.285948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.286731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.287021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.287304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.289549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad63d78-7c5c-42ab-b98a-cafe8ab94fd5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.294633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.296081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:36.311288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:36.312190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:36.313091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 244/502] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:36.313703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.321634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.327213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.327876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.328163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.328443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.329164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:36.329472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.330875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.342551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 259/503] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:36.343335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.419403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea01d1-a78f-423c-b074-a5bbf30c03a6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.442747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31229cd7-784d-4de3-bdfb-62356458e4e6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.446678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.452791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.453580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.453900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.454180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.464824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:36.472383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:36.473275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:36.474087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 245/504] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:36.474759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.481100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.481769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.482073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.482348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.483064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:36.483365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.484723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.500949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 260/505] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:36.500949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.549642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.577818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5097c8-f49e-4cb7-8ec2-d506f407b43c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.596510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e279a6-91aa-43e6-91b3-3892fd00b01d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.610480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.611135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.611420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.611706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.612413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:36.612718 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.614117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.626162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 246/506] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:36.626162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.635154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.635814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.636098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.636376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.637205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:36.637512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.638971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.674975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.677438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 261/507] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:36.678325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.728479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b39d5-ab41-462a-ba8a-7c8591b95540 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.761998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.762790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.763071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.763344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.770166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.771614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.782834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cdc4e-23bf-44a3-a998-446c13832cff None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:36.785927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:36.786794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:36.787738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 247/508] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:36.788329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.796041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.820183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.821268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.821557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.821857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.822599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:36.822902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.824269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.831988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 262/509] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:36.832763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.893522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0296-207b-45d3-8761-73f4c607331d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.905142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:36.929153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.929883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.930139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.930397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.931104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.931323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3814ad-1f71-4650-8229-2c093e042e04 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:36.932549 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:36.953029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 248/510] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:43:36 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:36.954173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:36.966992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:36.967814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:36.968112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:36.968392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:36.982767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:36.984264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:37.002517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:37.003552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:37.004434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 263/511] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:37.005004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.044807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.093102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67d308-a005-4170-abaa-9d7401fb1174 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.131228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.132197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.132739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.133025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.143570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ac33-a47a-4029-9310-d94f914dd932 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.173847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.184284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.184843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.185787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.185787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.186342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:37.186639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.187995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.206058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 264/512] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:37.207041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.215042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.216511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.301013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.314330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4350b-6991-4884-beae-d3d087c35320 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.320972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 249/513] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:37.322000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.355584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.356295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.356597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.356896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.367785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.369240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:37.389418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:37.390535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:37.391669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:37.391669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:37.391669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:37.391669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:37.391669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 265/514] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:37.391969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.399537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.433397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f8a87-feb5-445f-b550-c4d7febb07f3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.466777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.467450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.467728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.468003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.468827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:37.469132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.470584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.500434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d24be-5a0b-4aec-af44-a14bded9a87e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.507665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 250/515] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:37.508337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.541088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.548111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.548111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.548111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.559678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.613629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27171-79f9-4041-ac36-77a6aa784b8c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.622081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.623775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.638665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.651303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.652098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.652387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.652703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.662707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.664210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:37.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:37.683707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:37.684814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:37.684814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:37.684814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:37.684814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:37.686397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 251/516] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:37.687321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.735332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 266/517] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:37.736183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.784159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.795940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75e22-6374-42e8-87d5-e0806d0ba33d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.831371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.832032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.832317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.832598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.833322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:37.833628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.835064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.845463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7183f2f-6716-4cf4-8f27-aa515b98ee73 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.848177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 252/518] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:37.848967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:37.883378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:37.884299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.884955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.885502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.885934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.950463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521449e-f9f1-4c2e-8481-34173b020013 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:37.957290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.958780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:37.988260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:37.988922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:37.989208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:37.989487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:37.990225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:37.990529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:37.991882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.001302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.003645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 253/519] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:38.004600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.069646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 267/520] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:38.070630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.119233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.126097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b34f0-082f-4f44-9417-13813101aff2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.162942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.163652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.163959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.164908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.176417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.177896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.185444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3c69-ddb2-4dad-8f3d-8b8a0a716fbf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:38.194944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:38.196323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:38.197160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:38.197160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:38.197160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:38.197160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:38.197160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 254/521] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:38.198278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.225990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.226827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.227112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.227393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.234814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.236260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:38.250867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:38.251789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 268/522] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.257554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.311255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670a21-89eb-4174-ad83-f985714f6cfa None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.347841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.348876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.349460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.349781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.360048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.362528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.364038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4cb8f-0580-4193-a0fa-e454b0d42e05 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:38.377412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:38.378347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:38.379623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 255/523] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:38.380147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.391903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.412839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.413694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.413971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.414254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.424430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.425912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:38.443054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:38.443926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:38.444772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:38.444772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:38.444772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:38.444772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:38.444772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 269/524] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:38.445063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.491147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2ac0f-ffd3-45c5-ae54-0312b35e70c0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.506877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.526861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.527534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.527823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.528106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.528815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:38.529125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.530551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.541801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 256/525] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:38.547065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.556526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7dd9e-92ed-4da7-acda-559eab859cfb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.591899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.592592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.592878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.593160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.594023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:38.594336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.595767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.618408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 270/526] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:38.618408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.619900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.656537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f615-dd2a-4257-a297-9fc2ea17ef80 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.692050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.692769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.693054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.693383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.694195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:38.694505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.696568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.722812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 257/527] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:38.722812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.726568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736919-c33b-48d3-bede-358fa5ef8474 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.740694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.766433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.767109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.767393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.767674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.768406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:38.768808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.770114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.782856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 271/528] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:38.783484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.831316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0cf4f-fac0-4e77-9a22-37efc3f4c556 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.860313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:38.869139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.870214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.870676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.871147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.878131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:38.879762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:38.893777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7e0c0-7826-44e8-8582-b68d33b1a3b3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:38.894456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:38.895299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:38.896148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:38.898486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 258/529] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:38.899542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:38.938725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:38.939384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:38.939671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:38.939952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:38.984975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.011784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.013330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.014386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232884-f59b-4df8-a5e1-c47dd4db6e80 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.051349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.052009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.052293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.052568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.053390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=d89ce6057b2843f2bfbc5a143eb9300e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:39.053704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.055174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.060828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 259/530] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/role_assignments?user.id=d89ce6057b2843f2bfbc5a143eb9300e&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:39.061619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.122553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.167859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 272/531] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:39.167859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.189339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f7eb8-f78f-46cf-a487-85e959f62530 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.237072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.237871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.238162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.238444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.249344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.250873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.257505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:39.270318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:39.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:39.272343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 260/532] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:39.272795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.293596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49d3fa-6346-45db-91a5-1f69f8d5e159 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.328910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301001c7-b0c2-4f88-b7aa-34ccf26ee129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.329573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301001c7-b0c2-4f88-b7aa-34ccf26ee129 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.329895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301001c7-b0c2-4f88-b7aa-34ccf26ee129 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.330179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301001c7-b0c2-4f88-b7aa-34ccf26ee129 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.330965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301001c7-b0c2-4f88-b7aa-34ccf26ee129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:39.331271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301001c7-b0c2-4f88-b7aa-34ccf26ee129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.332714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301001c7-b0c2-4f88-b7aa-34ccf26ee129 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.350074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 273/533] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:39.351363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddb43b-939f-49d5-9ea2-f7a49a819511 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.351688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddb43b-939f-49d5-9ea2-f7a49a819511 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.351971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddb43b-939f-49d5-9ea2-f7a49a819511 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.357439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 274/534] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:39.357439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddb43b-939f-49d5-9ea2-f7a49a819511 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.386461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400eb5c-5fec-4888-9b3e-bfa5002b0f1c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.401727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.424339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.425227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.425583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.425974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.437040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.438759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:39.457259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:39.458361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:39.459405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:39.459405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:39.459405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:39.459405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:39.463014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 261/535] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:39.463845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.473349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddb43b-939f-49d5-9ea2-f7a49a819511 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.504780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.510895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eb127-550b-4f2f-8b4e-a7f04a78204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.512368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb127-550b-4f2f-8b4e-a7f04a78204a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.512657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb127-550b-4f2f-8b4e-a7f04a78204a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.513160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb127-550b-4f2f-8b4e-a7f04a78204a None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.514365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb127-550b-4f2f-8b4e-a7f04a78204a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:39.514780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb127-550b-4f2f-8b4e-a7f04a78204a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.516124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb127-550b-4f2f-8b4e-a7f04a78204a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.533509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 275/536] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:39.533509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a88a-3519-4baf-9480-20facabc1c8e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.533509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a88a-3519-4baf-9480-20facabc1c8e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.533509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a88a-3519-4baf-9480-20facabc1c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.548912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f8a8a88a-3519-4baf-9480-20facabc1c8e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:39.550126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f8a8a88a-3519-4baf-9480-20facabc1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:39.576638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e054-4955-4b45-9570-0543ab9bb320 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.612054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.612715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.613001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.613279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.614142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=22cb7c3278594d7a94f3d8c9cae9610a) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:39.614453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.615885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.621640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 262/537] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/role_assignments?user.id=22cb7c3278594d7a94f3d8c9cae9610a&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:39.622581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.638852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 276/538] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:39.639688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8a88a-3519-4baf-9480-20facabc1c8e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.660689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.750038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71740-bbee-4ea5-8142-91264dd05e2d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.765581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8a88a-3519-4baf-9480-20facabc1c8e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:39.791611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.792052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.793668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.794225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.794721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.795814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:39.796378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.798048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.809407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:39.810799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:39.811291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:39.811771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:39.816829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 263/539] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:39.816829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.817468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=795a9ecb4cd8448f81adbe68fdf967b9) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:39.818015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:39.819667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:39.828084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 277/540] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/role_assignments?user.id=795a9ecb4cd8448f81adbe68fdf967b9&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:39.829266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:39.941347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:39.966533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aed8e-02bb-412d-88fb-040d55c94ee4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:40.017414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f561-5080-4d5e-b1cd-af068165aba4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:40.045486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:40.046345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:40.046634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:40.046923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:40.066659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:40.075313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:40.076226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:40.077193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 264/541] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:40.082225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:40.084330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:40.085541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:40.087429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:40.087724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:40.098130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:40.099919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:40.119270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:40.120180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:40.121223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 278/542] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:40.127771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:40.202391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:40.261712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf5144-1a49-40af-876f-c885e898bb9b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:40.299794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:40.300689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:40.301140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:40.301579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:40.302538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:40.303309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:40.305456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:40.322564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 279/543] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:40.326767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:40.352606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef942e-4eed-446b-8d2c-e81a64140740 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:40.449093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ebefc-759d-43d3-ac71-f05cfe2cfce1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:40.474135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:40.479889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:40.480570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:40.480921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:40.481111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:40.485981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:40.486335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:40.487620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:40.487747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:40.488508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:40.488894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:40.489534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:40.490506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=2585af8b95ea48d1a3576bd722536fae) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:40.490923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:40.492565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:40.504900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 280/544] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:40 2022] GET /identity/v3/role_assignments?user.id=2585af8b95ea48d1a3576bd722536fae&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:40.520273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 265/545] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:40.526291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:40.641412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d01e-61b2-42ce-9709-988151eed450 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:40.678791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:40.679663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:40.679953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:40.680236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:40.691913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:40.693408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:40.712747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:40.713672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:40.714594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:40.714594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:40.714594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:40.714594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:40.714594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 281/546] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:40.719799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:40.750270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:40.863317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6337-86fd-4eb8-b35a-ee877ce84383 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:40.913990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:40.914616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:40.914900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:40.915182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:40.915906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:40.916218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:40.917604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:40.933461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 266/547] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:40.938971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:40.978121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:41.080035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f9994-0a1f-43d0-b829-4d931ba79571 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:41.114484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:41.115279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:41.115565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:41.115846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:41.124091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:41.125583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:41.140438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:41.143188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:41.145572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 282/548] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:41.152383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:41.269731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:41.301281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85d6c9-652d-4962-a0d8-7766d218d991 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:41.336270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bf230-6e0b-473d-b522-f5658aec40fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:41.336942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bf230-6e0b-473d-b522-f5658aec40fe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:41.337228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bf230-6e0b-473d-b522-f5658aec40fe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:41.337508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bf230-6e0b-473d-b522-f5658aec40fe None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:41.338371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bf230-6e0b-473d-b522-f5658aec40fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:41.338682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bf230-6e0b-473d-b522-f5658aec40fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:41.340129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bf230-6e0b-473d-b522-f5658aec40fe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:41.357863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 267/549] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 3 09:43:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:41.362995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:41.489039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:41.512102 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f7c2-91e2-434a-90a1-1dc371aef8a3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:41.553277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:41.554765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:41.555276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:41.555789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:41.601319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e0ba2-e7be-4b79-863e-0c9350a1b30b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:41.601601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e0ba2-e7be-4b79-863e-0c9350a1b30b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:41.601870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e0ba2-e7be-4b79-863e-0c9350a1b30b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:41.604472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 268/550] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:41.608671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac00ba-7dc0-4eb1-92be-b1f5d7133f00 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:41.608962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac00ba-7dc0-4eb1-92be-b1f5d7133f00 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:41.609241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac00ba-7dc0-4eb1-92be-b1f5d7133f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:41.626832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-15ac00ba-7dc0-4eb1-92be-b1f5d7133f00 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:41.628348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-15ac00ba-7dc0-4eb1-92be-b1f5d7133f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:41.679071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:41.681089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:41.743101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 269/551] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:41.774551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac00ba-7dc0-4eb1-92be-b1f5d7133f00 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:41.830212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:41.870311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 283/552] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:41.874994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:41.875493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:41.963974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac00ba-7dc0-4eb1-92be-b1f5d7133f00 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.035776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.036639 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.036926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.037208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.061388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:42.077309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:42.078759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:42.079780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:42.080856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f25467-971a-4621-961e-db05e8d77294 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.086617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 270/553] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:42.087665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.152288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.153337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.153788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.154237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.175740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:42.177227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:42.217041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:42.218198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:42.219358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:42.219358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:42.219358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:42.219358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:42.226958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 284/554] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:42.228724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.264980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4364d-bed1-4379-b2a5-79b3a26ecfad None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.282121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:42.285991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:42.306801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cb83-9ed5-481f-9375-0ecd9347aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.307501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cb83-9ed5-481f-9375-0ecd9347aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.307790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cb83-9ed5-481f-9375-0ecd9347aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.308077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cb83-9ed5-481f-9375-0ecd9347aad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.308908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105cb83-9ed5-481f-9375-0ecd9347aad1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:42.309231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105cb83-9ed5-481f-9375-0ecd9347aad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:42.310730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105cb83-9ed5-481f-9375-0ecd9347aad1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:42.319689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 271/555] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:42.321260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d3cb-de22-4f8c-b668-120622b5838e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.321560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d3cb-de22-4f8c-b668-120622b5838e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.321872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d3cb-de22-4f8c-b668-120622b5838e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.323335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 272/556] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:42.328059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d3cb-de22-4f8c-b668-120622b5838e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.362759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd0a55-06f3-47e5-8762-e1d9d1d9329e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.410058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ec421-8352-4876-bb71-3714ac5bbed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.411537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec421-8352-4876-bb71-3714ac5bbed3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.411840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec421-8352-4876-bb71-3714ac5bbed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.412126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec421-8352-4876-bb71-3714ac5bbed3 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.412916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ec421-8352-4876-bb71-3714ac5bbed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:42.413238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ec421-8352-4876-bb71-3714ac5bbed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:42.414709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ec421-8352-4876-bb71-3714ac5bbed3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:42.430729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 285/557] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:42.432163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8237eb-5fe0-4e19-a6a0-103b382cfddb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.432672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8237eb-5fe0-4e19-a6a0-103b382cfddb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.433155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8237eb-5fe0-4e19-a6a0-103b382cfddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.450544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-da8237eb-5fe0-4e19-a6a0-103b382cfddb None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:42.452030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-da8237eb-5fe0-4e19-a6a0-103b382cfddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:42.457134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d3cb-de22-4f8c-b668-120622b5838e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.502770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.504128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.504418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.504701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.520251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:42.521716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:42.534005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 286/558] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:42.534896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8237eb-5fe0-4e19-a6a0-103b382cfddb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:42.543676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:42.545025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:42.545916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:42.545916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:42.545916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:42.545916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:42.548113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 273/559] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:42.558704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.576431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:42.593781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:42.673712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313ffd-7ab1-4f4c-afc8-cab14aa39e40 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.678377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8237eb-5fe0-4e19-a6a0-103b382cfddb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.711792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.712509 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.712751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.713041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.713773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:42.714109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:42.715843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:42.725647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.727613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.728117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.728595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.729098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 274/560] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:42.730012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.738862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:42.740637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:42.755221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:42.756197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:42.757086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 287/561] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:42.757580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.835644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:42.847202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f6e79-4f4c-417a-b75b-ec305b16bf9f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.859392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:42.879151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365037e-6aa1-461f-bce9-f24e80c0e9fb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:42.884288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06128b-4cbf-4be6-83a2-89062c324928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.885087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06128b-4cbf-4be6-83a2-89062c324928 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.885375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06128b-4cbf-4be6-83a2-89062c324928 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.885656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06128b-4cbf-4be6-83a2-89062c324928 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.897097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06128b-4cbf-4be6-83a2-89062c324928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ea06128b-4cbf-4be6-83a2-89062c324928 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:42.905364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:42.906434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:42.907383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 275/562] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:42.908114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255dde6-6ef4-46f2-8079-7d0de94b4b23 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.908409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255dde6-6ef4-46f2-8079-7d0de94b4b23 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.908695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255dde6-6ef4-46f2-8079-7d0de94b4b23 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.910117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 276/563] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:42.914852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255dde6-6ef4-46f2-8079-7d0de94b4b23 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:42.921846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:42.922821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:42.923288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:42.923824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:42.932051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:42.933903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:42.952364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:42.953418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:42.954409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:42.954950 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 288/564] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:42.955490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.025477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255dde6-6ef4-46f2-8079-7d0de94b4b23 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.062104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea9caa-6ae5-4883-87bc-b5e0470fee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.062865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9caa-6ae5-4883-87bc-b5e0470fee08 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.063349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9caa-6ae5-4883-87bc-b5e0470fee08 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.063483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9caa-6ae5-4883-87bc-b5e0470fee08 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.064194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9caa-6ae5-4883-87bc-b5e0470fee08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:43.064507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9caa-6ae5-4883-87bc-b5e0470fee08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.065977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9caa-6ae5-4883-87bc-b5e0470fee08 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.069683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635592a5-8a20-4262-8543-a1158568ed9f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.078061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 277/565] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:43.079151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a6b0-5807-495c-8e1a-1ea6a7ee5c49 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.079451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a6b0-5807-495c-8e1a-1ea6a7ee5c49 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.079731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a6b0-5807-495c-8e1a-1ea6a7ee5c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.098957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-70c6a6b0-5807-495c-8e1a-1ea6a7ee5c49 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:43.100146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-70c6a6b0-5807-495c-8e1a-1ea6a7ee5c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:43.111289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.114212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.114888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.115182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.115465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.116222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:43.116535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.118468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.126725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 289/566] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:43.127359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.138761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.181038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 278/567] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:43.182168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a6b0-5807-495c-8e1a-1ea6a7ee5c49 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.234225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e75ee-74e6-47d5-a385-3ca53907c5b8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.268107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.268772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.269065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.269339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.270205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:43.270519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.272219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.282020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a6b0-5807-495c-8e1a-1ea6a7ee5c49 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.289009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 290/568] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:43.289824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.315452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c05d9-2a02-4e16-a7ac-9fbd9c917f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.316108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c05d9-2a02-4e16-a7ac-9fbd9c917f65 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.316392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c05d9-2a02-4e16-a7ac-9fbd9c917f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.316677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c05d9-2a02-4e16-a7ac-9fbd9c917f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.317537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c05d9-2a02-4e16-a7ac-9fbd9c917f65 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=b7b8474647dd40b0add7fdba5f24e3a7) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:43.318436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c05d9-2a02-4e16-a7ac-9fbd9c917f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.321437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c05d9-2a02-4e16-a7ac-9fbd9c917f65 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.326788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 279/569] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/role_assignments?user.id=b7b8474647dd40b0add7fdba5f24e3a7&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:43.327986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87a57a-41e2-4815-910e-859a99893a43 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.328275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87a57a-41e2-4815-910e-859a99893a43 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.328556 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87a57a-41e2-4815-910e-859a99893a43 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.329984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 280/570] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:43.330523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87a57a-41e2-4815-910e-859a99893a43 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.339322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.354408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.409140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86864-d6b4-40a5-939d-ccf4224065cf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.448114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.448926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.449213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.449498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.460339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.461216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87a57a-41e2-4815-910e-859a99893a43 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.461883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:43.481032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:43.482059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:43.483646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:43.483646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:43.483646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:43.483646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:43.483646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 291/571] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:43.483646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.508026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19a18d-6441-428b-b717-09f827d2f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.508840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a18d-6441-428b-b717-09f827d2f20e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.509115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a18d-6441-428b-b717-09f827d2f20e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.509391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a18d-6441-428b-b717-09f827d2f20e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.520557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19a18d-6441-428b-b717-09f827d2f20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8b19a18d-6441-428b-b717-09f827d2f20e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:43.528715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:43.529647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 281/572] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:43.532123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dbb5f-4f54-4438-80aa-249aa53b85a2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.532949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dbb5f-4f54-4438-80aa-249aa53b85a2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.532949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dbb5f-4f54-4438-80aa-249aa53b85a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.550323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-af8dbb5f-4f54-4438-80aa-249aa53b85a2 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:43.551510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-af8dbb5f-4f54-4438-80aa-249aa53b85a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:43.597348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875edbbf-cb91-40df-86b3-bbc97b0d47de None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.613428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.615815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.621884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 282/573] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:43.626602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dbb5f-4f54-4438-80aa-249aa53b85a2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.638422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.639267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.639608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.639887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.651288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.652745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:43.671313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:43.672241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:43.673138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:43.673138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:43.673138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:43.673138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:43.673138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 292/574] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:43.673412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.741849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dbb5f-4f54-4438-80aa-249aa53b85a2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.778159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.778835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.779117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.779397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.780115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:43.780423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.781590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ed372-a55a-4edf-8124-6658fa9aada5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.781814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.794788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 283/575] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:43.795888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.824587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.825227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.825511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.825977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.826644 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:43.826874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:43.828246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:43.841345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 293/576] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:43.841345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.858954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.877992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:43.904748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4755b0-4f6d-4f67-aa86-a970bb024057 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.938113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.938908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.939195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.939476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.949290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:43.954915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ba2d-a934-4e4a-89dd-81bda7afb7ac None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:43.956900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:43.958072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 284/577] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:43.958907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:43.996914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:43.997836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:43.998394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:43.998821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:43.999707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:44.000174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.001709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.014087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 294/578] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:44.015537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.063604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efeca7-7ed3-4741-a467-5d1e97bb5332 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.080395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.101007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.102495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.102818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.103103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.111817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.113408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.117719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.128279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f891c4-9ca5-4f77-b6ec-9ba84d94b5d8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:44.129374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:44.130325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:44.131268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 285/579] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:44.132440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.171443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.172236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.172528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.172811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.182908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.184356 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:44.202235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:44.203277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:44.204481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:44.204481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:44.204481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:44.204481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:44.204481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 295/580] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:44.204759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.238545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b8bc9-c545-44af-a818-311a84e5a9c8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.275778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.276787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.276906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.277261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.278176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:44.278562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.280011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.288962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 286/581] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:44.289572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.309917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17838f-8d56-4cff-895f-bd4bda96cf88 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.334584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.353456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.354421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.354807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.355155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.361981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.363492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:44.377735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:44.378689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:44.379597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:44.383687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 296/582] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:44.384330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.387319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.408598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294239d8-abde-4e9d-b019-a0d3d5ce5293 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.445771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.446548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.446843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.447588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.448731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:44.449055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.451000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.473486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 287/583] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:44.474290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.500452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cee1-6fa5-4640-bf61-09d4172df067 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.542637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.543236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.543526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.543805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.544560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:44.544872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.546295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.565459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 297/584] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:44.565459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.582367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.590926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b4838-99df-497a-91f9-1fb496ad6c69 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.623828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.632218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.633062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.633352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.633633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.644018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.645512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:44.663508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:44.665216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:44.666350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:44.666350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:44.666350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:44.666350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:44.666350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 288/585] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:44.669908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088efd0-2bf0-4edd-87b8-10d456ae5155 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.670416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.704676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.705452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.705741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.706046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.706837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:44.707147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.708582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.720525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 298/586] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:44.721322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.787801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221aa562-e897-48f9-8956-c7934db491d2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.826583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.827354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.827647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.828089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.833583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153fd8-5f75-42b9-8bff-705f56ccc6a7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:44.838707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.840171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.849163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.857509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:44.861231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:44.868124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:44.869018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:44.869018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:44.869018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:44.869018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:44.869018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 289/587] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:44.869018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.877394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:44.878228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:44.878517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:44.878798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:44.887410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:44.888845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:44.903297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:44.904254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 299/588] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:44.910025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:44.974871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4998a9-6f3c-4372-8a5c-b14f94b58321 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.011670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befbf05-f20b-4f2a-bcf6-64a681158342 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.011971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.012643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.012934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.013215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.014056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:45.014488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.015868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.029027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 290/589] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:45.029949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.051625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.052603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.052958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.053305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/d89ce6057b2843f2bfbc5a143eb9300e/roles/3a6e3fdefefd4f8396998db7f4c9a9c5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.071150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=d89ce6057b2843f2bfbc5a143eb9300e, role_id=3a6e3fdefefd4f8396998db7f4c9a9c5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.072621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.088204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 300/590] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:43:44 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/d89ce6057b2843f2bfbc5a143eb9300e/roles/3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:45.088898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.119511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.140838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.183915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832388-7b78-4fe2-afaf-32e2b85e347f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.227528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3afb-badd-4dba-a8dc-f6884117a61d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.233323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.234372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.234836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.235313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.236886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:45.237418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.239483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.262679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 291/591] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:45.262679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.286170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.287799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.288290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.288785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.291062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:45.291601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.293849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.315596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 301/592] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:45.316872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.394933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b449a4c-1248-4d32-8723-91773361a89f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.433522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.434361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.435106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.435397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.437866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.438066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.450342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.450864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76531a-5635-4d02-9ba9-2b3f74f00b62 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.452032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:45.475168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:45.476398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 09:43:45.477558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:45.481893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 292/593] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:45.482972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.499685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.500755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.501026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.501411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.508750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.510361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:45.525379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:45.526520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:45.527618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:45.529423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 302/594] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:45.530504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.602244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dc635-845c-4d1a-a5c9-f79aed905b2c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.635842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75228bfa-dc9b-46fa-a2c0-48d9c44aa148 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.638650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.640233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.640517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.640847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.654497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.655953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:45.673565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:45.674663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:45.675589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:45.675589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:45.675589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:45.675589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:45.675589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 293/595] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:45.675862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.677534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43d294-41f0-41fa-824b-799bb903764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.678395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d294-41f0-41fa-824b-799bb903764b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.678678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d294-41f0-41fa-824b-799bb903764b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.678959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d294-41f0-41fa-824b-799bb903764b None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.679847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43d294-41f0-41fa-824b-799bb903764b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:45.680156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43d294-41f0-41fa-824b-799bb903764b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.681597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43d294-41f0-41fa-824b-799bb903764b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.700454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 303/596] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:45.701788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419337b-3435-4987-b70b-bc8cfdf72e92 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.702075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419337b-3435-4987-b70b-bc8cfdf72e92 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.702355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419337b-3435-4987-b70b-bc8cfdf72e92 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.705799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 304/597] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:45.705799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419337b-3435-4987-b70b-bc8cfdf72e92 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.715614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.716142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.790645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f680e4-14fc-4ee0-b9e1-07f42c188262 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.817008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419337b-3435-4987-b70b-bc8cfdf72e92 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.826429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.827099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.827448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.828078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.828876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:45.829508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.830998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.847723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 294/598] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:45.847723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.858690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65d020-c2af-437b-8aa3-e49d7998d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:45.859352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d020-c2af-437b-8aa3-e49d7998d829 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.859642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d020-c2af-437b-8aa3-e49d7998d829 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.859931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d020-c2af-437b-8aa3-e49d7998d829 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.860655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65d020-c2af-437b-8aa3-e49d7998d829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:45.860963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65d020-c2af-437b-8aa3-e49d7998d829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:45.862381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65d020-c2af-437b-8aa3-e49d7998d829 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:45.874956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 305/599] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:45.876219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3665-6e9b-4677-b747-7cf1f0706375 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:45.876510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3665-6e9b-4677-b747-7cf1f0706375 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:45.876791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3665-6e9b-4677-b747-7cf1f0706375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:45.895952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-554e3665-6e9b-4677-b747-7cf1f0706375 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:45.897315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-554e3665-6e9b-4677-b747-7cf1f0706375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:45.949039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.959004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaa759-66c1-4e0b-a13c-31fb32aae5cd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:45.963390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:45.969797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 306/600] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:45.970265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3665-6e9b-4677-b747-7cf1f0706375 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:45.999995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.000871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.001082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.001360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.012892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.014381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:46.032299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:46.033203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:46.034494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:46.034494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:46.034494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:46.034494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:46.038043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 295/601] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:46.038903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.084366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3665-6e9b-4677-b747-7cf1f0706375 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.120457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.121342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.121626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.121937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/22cb7c3278594d7a94f3d8c9cae9610a/roles/3a6e3fdefefd4f8396998db7f4c9a9c5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.138147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=22cb7c3278594d7a94f3d8c9cae9610a, role_id=3a6e3fdefefd4f8396998db7f4c9a9c5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.139683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.147958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67528fe4-f16a-46cb-a571-0c70c24f932a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.161787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 307/602] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:43:45 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/22cb7c3278594d7a94f3d8c9cae9610a/roles/3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:46.161787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.196451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.197360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.197716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.198107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.205777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.207514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.221870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:46.228947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:46.229935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:46.230909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:46.231335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 296/603] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:46.232418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.237672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:46.305162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfb4a5-6d1a-4ade-ae22-f4b030a2e922 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.344444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.345249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.345536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.345863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.358740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:46.368338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:46.369387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 308/604] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:46.370287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.386099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c3fe-1e17-4ff9-8e22-9e61dbcb1478 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.426973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.427571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.427859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.428140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.429172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:46.429281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.431240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.444635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 297/605] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:46.448152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.491119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2366-dd6c-4a6d-8c69-68caef4b6891 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.500985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:46.528129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.528360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:46.528933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.529291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.529581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.530480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:46.532288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.532288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.547482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 309/606] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:46.548653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.584633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8122c9-c49f-4f63-8e55-9d536f9bd5ad None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.630428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.633174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.633472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.633778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.634817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:46.635131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.636789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.652735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 298/607] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:46.652735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.663314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e39c8-6b45-47e8-ad97-7c67fad008c9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.705902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.707058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.707541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.708033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.717943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.719825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:46.734100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:46.735003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:46.735888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:46.738484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 310/608] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:46.739566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.760696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a84b5-a0dc-4273-9c68-ef8f3de25290 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.771579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:46.789064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:46.803177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.803177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.803177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.803177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/795a9ecb4cd8448f81adbe68fdf967b9/roles/3a6e3fdefefd4f8396998db7f4c9a9c5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.817394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=795a9ecb4cd8448f81adbe68fdf967b9, role_id=3a6e3fdefefd4f8396998db7f4c9a9c5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.819037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.837546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 299/609] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:43:46 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/795a9ecb4cd8448f81adbe68fdf967b9/roles/3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:46.838538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.862285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01237329-9d83-4a00-b897-c4028818d347 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.901063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.902309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.902826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.903307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.916178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.918071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:46.937202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:46.938208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:46.939108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:46.939108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:46.939108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:46.939108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:46.941358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 311/610] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:46.947834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:46.956528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202d330-2aec-43e5-bd46-c435799cc0ed None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:46.995892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:46.996576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:46.996861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:46.997139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:46.998106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:46.998417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:46.999870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:47.013794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 300/611] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:47.023746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:47.041323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:47.062056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd73d49-a722-4326-b1d7-a4477282e670 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:47.096143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:47.110915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:47.114350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.115147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.115639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.117031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:47.119110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:47.121277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:47.145413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 312/612] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:47.152590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:47.263471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7322-496c-4f99-82c3-f0f7ad72f3d9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:47.279523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c466497-503c-42c0-b2b8-2a1984a8b23f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:47.311826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686e476-4fc8-49cb-9160-ad5205dabc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:47.313220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e476-4fc8-49cb-9160-ad5205dabc59 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.313579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e476-4fc8-49cb-9160-ad5205dabc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.313951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e476-4fc8-49cb-9160-ad5205dabc59 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/2585af8b95ea48d1a3576bd722536fae/roles/3a6e3fdefefd4f8396998db7f4c9a9c5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.321636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:47.322703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.323183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.323646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.331277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:47.332258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686e476-4fc8-49cb-9160-ad5205dabc59 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=2585af8b95ea48d1a3576bd722536fae, role_id=3a6e3fdefefd4f8396998db7f4c9a9c5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:47.333016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:47.334062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686e476-4fc8-49cb-9160-ad5205dabc59 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:47.336915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:47.356460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:47.357566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:43:47.358543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:47.359380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 313/613] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:47.364261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:47.376015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 301/614] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:43:47 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/2585af8b95ea48d1a3576bd722536fae/roles/3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:47.495643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c108-a4be-4cc8-b321-aba7c5f23c97 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:47.534949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:47.535614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.535907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.536191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.537064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:47.537379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:47.538981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:47.539439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab589-6f6e-4571-83b0-0de6df6cc9c8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.539737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab589-6f6e-4571-83b0-0de6df6cc9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.540023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab589-6f6e-4571-83b0-0de6df6cc9c8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.541739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 302/615] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:47.547857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd394-dc8a-4096-a20c-ec8058905638 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.548176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd394-dc8a-4096-a20c-ec8058905638 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.548415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd394-dc8a-4096-a20c-ec8058905638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.565150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 314/616] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 3 09:43:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:47.570844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:47.587624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3abcd394-dc8a-4096-a20c-ec8058905638 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:47.588914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3abcd394-dc8a-4096-a20c-ec8058905638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:47.658939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:47.709443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef65f9-b151-4fe8-abbd-0eed11b65c28 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:47.720484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 303/617] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:47.744656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcd394-dc8a-4096-a20c-ec8058905638 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:47.755554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:47.756363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.756648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.756925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.768689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:47.777015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:47.779490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:47.804229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:47.805692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:47.806813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:47.806813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:47.806813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:47.806813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:47.806813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 315/618] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:47.811269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:47.902592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcd394-dc8a-4096-a20c-ec8058905638 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:47.947255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:47.948543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:47.949289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:47.949892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:47.955386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530bf06-3466-4bda-ba1c-b8aaaac55c93 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:47.966406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:47.968688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:47.985440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:47.986453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:47.987295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:47.989810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 304/619] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:47.996424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:47.998148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:47.999348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.001486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.001988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.002867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:48.004413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:48.006048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:48.031239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 316/620] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:48.036219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:48.093835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:48.123590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918632-78c4-4c5f-8edf-93c2183556ec None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:48.175317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:48.175990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.178469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.178932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.180267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:48.180585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:48.182002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:48.207984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 305/621] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:48.213616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:48.263896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e4468-fc84-4802-a5bc-cdc5963be786 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:48.332731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97024b-9f6a-4b23-a990-d9482458ea8b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:48.354565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:48.355294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.355577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.355855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.369782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:48.371263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:48.375878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:48.376875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.377165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.377446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.395115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:48.403303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:48.404797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:48.408316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:48.409225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:48.410163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 317/622] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:48.418738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:48.437652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:48.439766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:48.441953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:48.441953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:48.441953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:48.441953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:48.446458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 306/623] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:48.454767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:48.474773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:48.565255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71b2a4-584f-4eb1-a718-c0f2b0b13616 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:48.625649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:48.626261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.626550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.626831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.627630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:48.627941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:48.629387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:48.658075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 318/624] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:48.658928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:48.680859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aceb3-43e8-44d8-9963-ee104f6cc99d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:48.744347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:48.745023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.746753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.747040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.747767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:48.748081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:48.749463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:48.774469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 307/625] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:48.779992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:48.826363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:48.843710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb6697-a26f-40cb-a122-e9c902e98140 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:48.882241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:48.917636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a52d8-a46d-446e-999b-616fc1417a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:48.918560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a52d8-a46d-446e-999b-616fc1417a08 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.918848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a52d8-a46d-446e-999b-616fc1417a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.919126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a52d8-a46d-446e-999b-616fc1417a08 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/b7b8474647dd40b0add7fdba5f24e3a7/roles/3a6e3fdefefd4f8396998db7f4c9a9c5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.935205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a52d8-a46d-446e-999b-616fc1417a08 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=b7b8474647dd40b0add7fdba5f24e3a7, role_id=3a6e3fdefefd4f8396998db7f4c9a9c5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:48.936675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a52d8-a46d-446e-999b-616fc1417a08 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:48.951077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 319/626] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:43:48 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/b7b8474647dd40b0add7fdba5f24e3a7/roles/3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:43:48.952821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da709-26de-4e27-a949-3d13dc56e713 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.953118 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da709-26de-4e27-a949-3d13dc56e713 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.953457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da709-26de-4e27-a949-3d13dc56e713 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:48.955061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 320/627] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:48.959591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91e9d4-31d7-45d6-89ec-a334ea865d36 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:48.971347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2cdcb-f386-42a0-a006-7f5189034dac None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:48.971676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2cdcb-f386-42a0-a006-7f5189034dac None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:48.971903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2cdcb-f386-42a0-a006-7f5189034dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.003310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:49.004948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.005441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.006076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.010937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4be2cdcb-f386-42a0-a006-7f5189034dac None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:49.012177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4be2cdcb-f386-42a0-a006-7f5189034dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:49.015698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:49.017601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:49.034738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:49.035797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:49.036842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:49.040276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 308/628] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:43:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:49.045591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:49.152730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 321/629] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:49.165733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78c9e-6f98-4c2a-ba79-5410a82a409a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:49.177614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:49.186814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2cdcb-f386-42a0-a006-7f5189034dac None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:49.210071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:49.211467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.211889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.212329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.213271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:49.213689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:49.215378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:49.237409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 309/630] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:49.243150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:49.287818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:49.348830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2cdcb-f386-42a0-a006-7f5189034dac None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:49.385897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db24c-07fe-42b5-b65e-458e70ea476c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:49.397847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:49.398927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.399358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.399780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.412910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:49.421850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8abb85-3891-4d51-b1e7-fd230c38b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:49.422504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8abb85-3891-4d51-b1e7-fd230c38b497 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.422788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8abb85-3891-4d51-b1e7-fd230c38b497 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.423066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8abb85-3891-4d51-b1e7-fd230c38b497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:49.423360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:49.424452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:49.425482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:49.428186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 322/631] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:49.433993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:49.490472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:49.563246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8abb85-3891-4d51-b1e7-fd230c38b497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:49.565733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8abb85-3891-4d51-b1e7-fd230c38b497 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:49.600179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cd120-40e8-4c0e-aee3-da39ca8b8318 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:49.630474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:49.638135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:49.639011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.639445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.640088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.641406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:49.641896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:49.643567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:49.654847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 323/632] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:49.660690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:49.736361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 310/633] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 09:43:49.737949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764af9-0365-45cf-869a-e2a515a3ec17 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.738357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764af9-0365-45cf-869a-e2a515a3ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.738771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764af9-0365-45cf-869a-e2a515a3ec17 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.740439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 311/634] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:49.741232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764af9-0365-45cf-869a-e2a515a3ec17 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:49.788165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67d2ec-bfe8-4793-a612-49b65e2903d2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:49.822922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:49.827923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158812-0afa-4da1-b806-15b7fef99f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:49.829247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158812-0afa-4da1-b806-15b7fef99f6c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.829675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158812-0afa-4da1-b806-15b7fef99f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.830115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158812-0afa-4da1-b806-15b7fef99f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.842650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9158812-0afa-4da1-b806-15b7fef99f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:49.844409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9158812-0afa-4da1-b806-15b7fef99f6c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:49.860422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764af9-0365-45cf-869a-e2a515a3ec17 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d9158812-0afa-4da1-b806-15b7fef99f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:49.863839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:49.864788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:49.865668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:49.865668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:49.865668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:49.865668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:49.867740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 324/635] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:49.869264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faffbe6-6330-46c8-bcc6-40bc3e05a7c7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.869798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faffbe6-6330-46c8-bcc6-40bc3e05a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.870274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faffbe6-6330-46c8-bcc6-40bc3e05a7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.888879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8faffbe6-6330-46c8-bcc6-40bc3e05a7c7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:49.890483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8faffbe6-6330-46c8-bcc6-40bc3e05a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:49.897667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:49.899074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:49.899367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:49.899645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:49.911668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:49.913294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:49.934820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:49.935804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:49.936683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:49.936683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:49.936683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:49.936683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:49.941431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:49.941619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 312/636] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:49.943962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:49.973644 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 325/637] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:49.975016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faffbe6-6330-46c8-bcc6-40bc3e05a7c7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.075658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34bbe-8e32-46e3-a389-0a8962d09840 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.080426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faffbe6-6330-46c8-bcc6-40bc3e05a7c7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.099084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.115264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.115940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.116225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.116555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.117248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:50.117555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.119090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.127783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.128737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.129230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.129701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.130663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:50.130921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 313/638] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:50.131431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.131723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.133378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.146650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 326/639] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:50.148746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.186275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.246270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc39d08-10c7-416b-8d8d-466f4c3bc3d5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.259738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129ebb-3499-49d2-b564-5f487c351eee None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.284519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.285320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.285621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.285927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.296100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfee345-c160-45f6-8cb0-943dd07f0f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.296834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:50.297390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee345-c160-45f6-8cb0-943dd07f0f61 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.297978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee345-c160-45f6-8cb0-943dd07f0f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.298448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee345-c160-45f6-8cb0-943dd07f0f61 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:50.305792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:50.306787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:50.307637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:50.309601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfee345-c160-45f6-8cb0-943dd07f0f61 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.310229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 314/640] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:50.311285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfee345-c160-45f6-8cb0-943dd07f0f61 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.311402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8bfee345-c160-45f6-8cb0-943dd07f0f61 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:50.325857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:50.326871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:50.327820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 327/641] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:50.328979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e14ce-3168-47b8-9c25-09cf46ee3582 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.328979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e14ce-3168-47b8-9c25-09cf46ee3582 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.329135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e14ce-3168-47b8-9c25-09cf46ee3582 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.331711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 328/642] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:50.331711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e14ce-3168-47b8-9c25-09cf46ee3582 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.363599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.435142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.438096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c256-3786-4e16-b707-df0b8094d3ff None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.443881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e14ce-3168-47b8-9c25-09cf46ee3582 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.474076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9850a-637e-48a9-a3df-6d89f5a1c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.474956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9850a-637e-48a9-a3df-6d89f5a1c9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.475312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9850a-637e-48a9-a3df-6d89f5a1c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.475654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9850a-637e-48a9-a3df-6d89f5a1c9e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.478231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.478900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.479184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.479466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.480206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:50.480515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.481924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.483238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9850a-637e-48a9-a3df-6d89f5a1c9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.484703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9850a-637e-48a9-a3df-6d89f5a1c9e8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.490426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 329/643] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:50.495864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6eb9850a-637e-48a9-a3df-6d89f5a1c9e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:50.499564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:50.500600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:50.501698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 315/644] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:50.502233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0457f-7739-4660-92fb-761c7e9e641e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.502750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0457f-7739-4660-92fb-761c7e9e641e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.502850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0457f-7739-4660-92fb-761c7e9e641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.519141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4bc0457f-7739-4660-92fb-761c7e9e641e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:50.520337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4bc0457f-7739-4660-92fb-761c7e9e641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:50.590285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 316/645] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:50.591322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0457f-7739-4660-92fb-761c7e9e641e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.617635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ad56-c001-4f0e-833f-4b95d316ebdb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.631034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.656745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.657566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.657950 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.658296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.659229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:50.659608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.661121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.685234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 330/646] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:50.685234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.700227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.704091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0457f-7739-4660-92fb-761c7e9e641e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.738204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.739023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.739310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.739592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.751219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.753502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:50.776542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:50.777470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:50.778441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:50.778441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:50.778441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:50.778441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:50.779392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 317/647] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:50.780221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.794600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75120789-37c8-492b-9c88-5e6ade6a292b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.836045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.836849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.837177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.837483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.838317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:50.838634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:50.840073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:50.852591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 331/648] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:50.853342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.873287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.896079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d23a4-8d06-4a90-898e-9d342c2d4eae None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:50.933496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:50.934328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:50.934612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:50.935034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:50.935564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:50.946552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:50.954220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:50.955215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:50.956068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 318/649] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:50.956781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:50.969899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d988-bfdb-4ec7-b790-bafa1a665026 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.005895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.006550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.006838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.007119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.065100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af2b86-6a11-49a5-93cb-680c516833ef None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.082051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.083572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.104833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.106249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.107205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.107867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.108877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:51.109606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.111871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.128085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 319/650] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:51.129045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.131709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:51.164912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:51.194029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 332/651] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:51.198621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.237389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997574-73d8-4ceb-aaa8-6dc665ef347a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.272985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.273683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.273996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.274279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.275106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=d89ce6057b2843f2bfbc5a143eb9300e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:51.275420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.276879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.282939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 320/652] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/role_assignments?user.id=d89ce6057b2843f2bfbc5a143eb9300e&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:51.283716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.322542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251b334-5d63-494e-af7d-4589742719ed None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.362912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.363521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.363808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.364085 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.364856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:51.365164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.367375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.379605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 333/653] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:51.380492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.383368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:51.431763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:51.435627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520f785-b9d5-4f1a-8ccc-6cd145d74fc6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.489868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.490713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.491000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.491347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.499555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.501104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:51.516425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:51.517607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:43:51.518858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:51.519491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9aaf-078d-4533-bbd4-c33a9f478802 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.519580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 321/654] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:51.519580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.573898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec348c1-6a6e-41d8-9510-cab287727e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.574827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec348c1-6a6e-41d8-9510-cab287727e9a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.575646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec348c1-6a6e-41d8-9510-cab287727e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.575932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec348c1-6a6e-41d8-9510-cab287727e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.594015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec348c1-6a6e-41d8-9510-cab287727e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.595390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec348c1-6a6e-41d8-9510-cab287727e9a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8ec348c1-6a6e-41d8-9510-cab287727e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:51.614693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:51.615620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:51.616551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:51.616551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:51.616551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:51.616551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:51.616551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 334/655] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:51.617986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d77c-76c5-4b7a-af88-d1f5f4969ad8 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.617986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d77c-76c5-4b7a-af88-d1f5f4969ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.618243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d77c-76c5-4b7a-af88-d1f5f4969ad8 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.619710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 335/656] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:51.620460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d77c-76c5-4b7a-af88-d1f5f4969ad8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.644859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98135d3-2e31-4d5c-b3d5-52ef74137420 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.680171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:51.692559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.693458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.693841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.694123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.709208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.710766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:51.730875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:51.731844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:51.732772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:51.732772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:51.732772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:51.732772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:51.732772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 322/657] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:51.733461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.753939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:51.771318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d77c-76c5-4b7a-af88-d1f5f4969ad8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.809137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3a2ee-ef0c-49c2-b8a1-dd3386958506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.809951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a2ee-ef0c-49c2-b8a1-dd3386958506 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.810242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a2ee-ef0c-49c2-b8a1-dd3386958506 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.810526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a2ee-ef0c-49c2-b8a1-dd3386958506 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.811376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a2ee-ef0c-49c2-b8a1-dd3386958506 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:51.811695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a2ee-ef0c-49c2-b8a1-dd3386958506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.813312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a2ee-ef0c-49c2-b8a1-dd3386958506 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.830835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 336/658] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:51.830835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607724-2127-466a-a032-2389cbc86b90 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.830835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607724-2127-466a-a032-2389cbc86b90 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.830835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607724-2127-466a-a032-2389cbc86b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.845016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7e22-24be-4e29-a19f-542c7df36f14 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:51.849603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-de607724-2127-466a-a032-2389cbc86b90 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:51.850818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-de607724-2127-466a-a032-2389cbc86b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:51.880851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:51.881443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:51.881726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:51.882034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:51.883281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:51.883590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:51.884962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:51.901032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 323/659] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:51.901032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.933787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 337/660] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:51.933787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de607724-2127-466a-a032-2389cbc86b90 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:51.943997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.008872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e6a64-bceb-4720-a95c-64904ec4b22b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.022417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.043734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.044392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.044682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.044951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.045664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:52.045997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.047368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.048610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de607724-2127-466a-a032-2389cbc86b90 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.064276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 324/661] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:52.064276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.088316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.089084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.089426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.089716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.162387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.166046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f99b07-6a5d-4be3-85d6-dca18bb32499 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.167296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.169555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.200464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.201253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.201541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.201844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.208379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.209875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:52.224289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:52.225217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 325/662] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:52.227487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.256275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.287542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 338/663] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:52.287542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.334579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85356a-b0a1-4cb5-aaae-a5aadf60a931 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.370750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.371540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.371828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.372110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.382800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:52.390759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:52.391761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:52.392596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 326/664] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:52.393282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.399833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44fc7-f295-4679-8919-f96a01fbe811 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.413489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.436464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.437589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.437589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.437812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.445038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.446612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:52.460977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:52.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 339/665] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:52.462969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.501272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.506889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809c45-1266-40fc-8e53-bc02ac9e41a2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.546373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.547071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.547357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.548090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.548884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:52.549199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.551349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.564210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 327/666] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:52.565371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.577799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d760eb-40fb-41db-acf5-37282c56a645 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.616255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.617127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.617421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.617703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.635601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.637082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:52.658051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:52.659048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:52.660103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:52.660103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:52.660103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:52.660103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:52.663812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.664612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 340/667] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:52.666559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.691687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb2dab-2c40-4065-b49b-469041f6025a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.731254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.731928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.732217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.732483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.733223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:52.733708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.735449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.758072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 328/668] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:52.759708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.769160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:52.783650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53718614-179a-4eb2-9a73-d50bde1a07e0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.825574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.826274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.826564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.826844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.827694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:52.828006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.829455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.854871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 341/669] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:52.854871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.915758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973577bb-b145-4a06-9d5e-edfd4e1123e7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.969036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:52.970200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:52.970706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:52.971208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:52.972793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=22cb7c3278594d7a94f3d8c9cae9610a) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:52.973120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:52.974963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:52.982076 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb419667-9727-4818-a300-bcb2cc539925 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:52.993784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 329/670] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/role_assignments?user.id=22cb7c3278594d7a94f3d8c9cae9610a&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:52.993784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:52.997503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.027166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.027845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.028131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.028487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.029232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:53.029589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.031203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.049219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 342/671] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:53.049219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.057565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.150216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16487-f3a7-4593-bfe8-28c29bd874fe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.175892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488ba55-3b3c-4818-939b-0d48657fd987 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.190548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.191395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.191688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.191975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.204134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.205633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.218498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.219541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.220039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.220518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:53.225935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:53.227363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:53.228238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:53.228238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:53.228238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:53.228238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:53.231956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 330/672] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:53.232902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.302533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.317550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.318724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.329529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.377558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ab06-e07c-49e6-bc89-f54bab1e5472 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.431958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.432672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.432958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.433239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.443643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.446396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.453633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 343/673] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:53.454796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:53.463582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:53.464489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:53.465843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 331/674] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:53.470747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.576773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01346f1-3400-442d-9ac4-e3494d696153 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.589975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.596771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38404e8-185e-4eab-b443-779c0ef22ffc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.615414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.629659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65499acb-500f-40f7-b526-651797212d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.630646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65499acb-500f-40f7-b526-651797212d87 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.630940 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65499acb-500f-40f7-b526-651797212d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.631223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65499acb-500f-40f7-b526-651797212d87 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.631962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65499acb-500f-40f7-b526-651797212d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:53.632275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65499acb-500f-40f7-b526-651797212d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.635138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65499acb-500f-40f7-b526-651797212d87 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.639462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.640576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.641130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.641642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.648905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 344/675] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:53.649442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65499acb-500f-40f7-b526-651797212d87 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.656195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.658395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:53.681148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:53.682420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:53.683372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:53.683372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:53.683372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:53.683372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:53.689726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 332/676] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:53.690891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.779426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65499acb-500f-40f7-b526-651797212d87 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.799325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca9963-c16b-426c-9e62-761d5df47aeb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.816146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.817203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.817486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.817998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.819091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:53.819408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.821462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.835274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 345/677] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:53.836150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.847462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce6c4f-3f2e-4237-8062-ec198ffc875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.848353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6c4f-3f2e-4237-8062-ec198ffc875c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.848589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6c4f-3f2e-4237-8062-ec198ffc875c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.848865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6c4f-3f2e-4237-8062-ec198ffc875c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.857118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce6c4f-3f2e-4237-8062-ec198ffc875c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:53.858747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce6c4f-3f2e-4237-8062-ec198ffc875c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:53.870939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-25ce6c4f-3f2e-4237-8062-ec198ffc875c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:53.875361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:53.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:53.877468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 333/678] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:53.878491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ef11-00ca-4c34-a0a2-1584886e52e5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.878491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ef11-00ca-4c34-a0a2-1584886e52e5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.878491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ef11-00ca-4c34-a0a2-1584886e52e5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.880061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 334/679] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:53.883432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223ef11-00ca-4c34-a0a2-1584886e52e5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:53.916145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:53.959691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086b89-c680-4d20-a2eb-7e8efb6c0095 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:53.997708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:53.998514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:53.998874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:53.999222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:53.999375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223ef11-00ca-4c34-a0a2-1584886e52e5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.000073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:54.000449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.001944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.014610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 346/680] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:54.015518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.041127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bbc2d-a075-4c6f-932c-c8b88e5eb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.041809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bbc2d-a075-4c6f-932c-c8b88e5eb506 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.042104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bbc2d-a075-4c6f-932c-c8b88e5eb506 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.042387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bbc2d-a075-4c6f-932c-c8b88e5eb506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.043258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bbc2d-a075-4c6f-932c-c8b88e5eb506 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=795a9ecb4cd8448f81adbe68fdf967b9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:54.043579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bbc2d-a075-4c6f-932c-c8b88e5eb506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.045040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bbc2d-a075-4c6f-932c-c8b88e5eb506 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.051240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 335/681] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:53 2022] GET /identity/v3/role_assignments?user.id=795a9ecb4cd8448f81adbe68fdf967b9&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:54.059363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47264d-8f7c-4be9-91a4-728b51dba489 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.060746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47264d-8f7c-4be9-91a4-728b51dba489 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.061237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47264d-8f7c-4be9-91a4-728b51dba489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.086030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0c47264d-8f7c-4be9-91a4-728b51dba489 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:54.088557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0c47264d-8f7c-4be9-91a4-728b51dba489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:54.121927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:54.143138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b478203-4e8e-44a4-8aa1-d418193497cf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.185691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.186286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.186690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.187148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.188005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:54.188386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.190258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.196974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 336/682] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:54.198556 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47264d-8f7c-4be9-91a4-728b51dba489 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.228334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:54.238497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 347/683] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:54.239682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.333787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47264d-8f7c-4be9-91a4-728b51dba489 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.374278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3329b-3d66-43a7-b08e-dbca3ec2e1b5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.374475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.375121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.378146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.378453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.390826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.392627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:54.412201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:54.413168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:54.414397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:54.417877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 337/684] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:54.419021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.424634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.424634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.424988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.425200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.436676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:54.444360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:54.445905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:54.446745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:54.450971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 348/685] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:54.451839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.461222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:54.527986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:54.544202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da90bb-b748-4f05-be72-5bff8afc834b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.565257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91e62-b9fd-48ca-83ae-cba8e9696e1a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.579309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.580267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.580754 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.581246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.600699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.602061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.602358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.602697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.603496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:54.603811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.605315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.624646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 349/686] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:54.624646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.659226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.661092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.690318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:54.734537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28588-e39e-4d49-a35d-5860e10bf4c1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.745239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:54.767188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 338/687] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:54.768364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.776313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.776985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.777276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.777569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.778530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:54.778975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.780748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.795000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 350/688] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:54.795998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.871180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d5c9-9d8a-4dad-bb06-91eb83183751 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.909300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc3f0-2d82-4b7e-bdfb-82de4ef95e6b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:54.914726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.916123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.916606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.917074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.918144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=2585af8b95ea48d1a3576bd722536fae) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:54.918671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.920310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.935334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 339/689] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/role_assignments?user.id=2585af8b95ea48d1a3576bd722536fae&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:54.937387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:54.937945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:54.949929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:54.950736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:54.951027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:54.951311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:54.964828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:54.966571 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:54.986475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:54.987432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:54.988350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:54.988350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:54.988350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:54.988350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:54.988350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 351/690] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:54.998117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.067240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:55.115646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4181-20f0-480b-ac87-c9facba3b200 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.159032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.159714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.160005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.160291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.161032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:55.161346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:55.162811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:55.177316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 352/691] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:55.182743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.219142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a5b34-8f23-4d06-9790-c44354092e5d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.248124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:55.287552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.288529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.288854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.289141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.302769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:55.304241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:55.330554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:55.331498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:55.332507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:55.332507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:55.332507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:55.332507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:55.336823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 340/692] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:55.338440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.344677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edfc5-61f9-4b5d-aeb0-6cc4f6c28fca None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.416046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.416858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.417141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.417419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.430981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:55.432458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:55.452818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:55.453812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:55.454730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 353/693] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:55.464388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.501225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:55.506259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c0298-50a1-4fa3-a781-72119dfda2f2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.551186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08281a-f2c2-45f0-87cd-7024978e8211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.552115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08281a-f2c2-45f0-87cd-7024978e8211 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.552412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08281a-f2c2-45f0-87cd-7024978e8211 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.553571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08281a-f2c2-45f0-87cd-7024978e8211 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.554377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08281a-f2c2-45f0-87cd-7024978e8211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:55.554695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08281a-f2c2-45f0-87cd-7024978e8211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:55.556095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08281a-f2c2-45f0-87cd-7024978e8211 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:55.571692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 341/694] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:55.573146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e241f38-833e-4d42-b73a-9bf8106734d8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.573447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e241f38-833e-4d42-b73a-9bf8106734d8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.573739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e241f38-833e-4d42-b73a-9bf8106734d8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.579262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 342/695] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:55.579262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e241f38-833e-4d42-b73a-9bf8106734d8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.589647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:55.594102 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4b3b7-9fc5-48a2-94ae-d71d2a2b0b94 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.631351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00557a-6abc-468f-95ae-6de0e8dc303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.632983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00557a-6abc-468f-95ae-6de0e8dc303a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.633379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00557a-6abc-468f-95ae-6de0e8dc303a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.633781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00557a-6abc-468f-95ae-6de0e8dc303a None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.634806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00557a-6abc-468f-95ae-6de0e8dc303a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:55.635220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00557a-6abc-468f-95ae-6de0e8dc303a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:55.636779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00557a-6abc-468f-95ae-6de0e8dc303a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:55.654665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 354/696] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:55.655902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2ca67-9fcc-407f-8eeb-7aad086baac4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.656195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2ca67-9fcc-407f-8eeb-7aad086baac4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.656478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2ca67-9fcc-407f-8eeb-7aad086baac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.675886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-04e2ca67-9fcc-407f-8eeb-7aad086baac4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:55.677081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-04e2ca67-9fcc-407f-8eeb-7aad086baac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:55.712561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e241f38-833e-4d42-b73a-9bf8106734d8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.756905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.758258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 355/697] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:55.759132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.759244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2ca67-9fcc-407f-8eeb-7aad086baac4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.759753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.760253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.770015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:55.777181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:43:55.796650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:55.797654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:43:55.799416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:55.806217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 343/698] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:43:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:55.806217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.826570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:55.884620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:55.898844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2ca67-9fcc-407f-8eeb-7aad086baac4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.924167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344714-89be-49cf-bc7c-f37696b53591 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:55.935345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.936005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.936295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.936566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:55.937401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=b7b8474647dd40b0add7fdba5f24e3a7) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:55.937716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:55.939209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:55.945822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 356/699] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:55 2022] GET /identity/v3/role_assignments?user.id=b7b8474647dd40b0add7fdba5f24e3a7&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:55.946836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:55.979680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:55.980867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:55.981335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:55.981910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.006849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:56.008748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:56.036683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:56.037675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:56.038603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:56.038603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:56.038603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:56.038603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:56.041672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 344/700] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:56.057700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:56.077799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5545f-607a-47d5-8030-ce7ff73c83d6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:56.117680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:56.118398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.118685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.118965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.120890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:56.121211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:56.122737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:56.167246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 357/701] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:43:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:56.170390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:56.188732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:56.190480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:56.225494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e306-61ad-4b6b-a589-2f0497137f7a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:56.263829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:56.264970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.265442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.265996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.266896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:56.267399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:56.268966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:56.283242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 345/702] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:56.290034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:56.295593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e2ca-d053-455d-9ab3-db83ae287737 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:56.343678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:56.345181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.345672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.346248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.433052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f8e9-c38c-4569-88ab-982e1698d986 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:56.445961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:56.447538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:56.461581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:56.474995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:56.485620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0bce-0342-4e17-9a16-957d66b602e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:56.487222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0bce-0342-4e17-9a16-957d66b602e8 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.487502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0bce-0342-4e17-9a16-957d66b602e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.487774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0bce-0342-4e17-9a16-957d66b602e8 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.488479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0bce-0342-4e17-9a16-957d66b602e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:56.489994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0bce-0342-4e17-9a16-957d66b602e8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:56.525688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 346/703] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:43:56 2022] POST /identity/v3/users => generated 254 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:43:56.525688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc50d-ea2a-4126-a360-476ac52a83f7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.525688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc50d-ea2a-4126-a360-476ac52a83f7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.525688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc50d-ea2a-4126-a360-476ac52a83f7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.525688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 347/704] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:56.532086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4763-c3aa-48d4-9fe2-183bfca7aa14 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.532383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4763-c3aa-48d4-9fe2-183bfca7aa14 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.532662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4763-c3aa-48d4-9fe2-183bfca7aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.552996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a58e4763-c3aa-48d4-9fe2-183bfca7aa14 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:56.554861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a58e4763-c3aa-48d4-9fe2-183bfca7aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:56.647923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 358/705] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:43:56.653288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:56.687493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 348/706] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:56.732090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4763-c3aa-48d4-9fe2-183bfca7aa14 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:56.801064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d211-0fad-4656-8283-196b890e4609 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:56.821682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:56.854025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:56.855147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.855682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.856119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.869271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:56.871013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:56.880114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4763-c3aa-48d4-9fe2-183bfca7aa14 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:43:56.894177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:56.895315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:56.896391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:43:56.896391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:43:56.896391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:43:56.896391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:56.896391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 359/707] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:56.902485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:56.910103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:56.927756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:56.929998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:56.930892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:56.931706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:56.933322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:56.936463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:56.957596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:56.958678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:43:56.959508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:56.962901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 349/708] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Jun 3 09:43:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:56.969489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:57.037714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ca25-dfbe-4347-9897-a2d936561c6a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:57.098382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:57.099056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:57.099348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:57.099632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:57.100365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:57.100678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:57.106873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:57.136691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 360/709] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:57.137622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:57.151790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd30e3a-a949-4add-b5bd-d7ca862d5f5c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:57.188698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:57.197704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:57.198846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:57.199354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:57.199829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:57.200741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:57.201245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:57.203043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:57.209017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 350/710] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 3 09:43:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:43:57.214074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:57.274403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:57.337707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f9ea-6040-43b0-ae13-328cf2a122c6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:57.368597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c55b6-0dae-484a-893a-977591d18171 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:57.393895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:57.394849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:57.396610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:57.397353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:57.399748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:57.400323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:57.401939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:57.417115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 351/711] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 3 09:43:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:57.427579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:57.428763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:57.429249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:57.429834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:57.437973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:57.439707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:43:57.455411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:57.456404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:43:57.457316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:57.459964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 361/712] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:57.465885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:57.643145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f8bfd-7cd4-4edb-a5d3-671844b7dbde None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:57.655318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:57.682133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60604d6e-38c9-407d-8661-12b0d4afd4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:57.682805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60604d6e-38c9-407d-8661-12b0d4afd4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:57.683093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60604d6e-38c9-407d-8661-12b0d4afd4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:57.683370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60604d6e-38c9-407d-8661-12b0d4afd4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:57.684162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60604d6e-38c9-407d-8661-12b0d4afd4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:57.684472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60604d6e-38c9-407d-8661-12b0d4afd4d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:57.685972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60604d6e-38c9-407d-8661-12b0d4afd4d7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:57.699722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 352/713] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:57.705208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:57.828938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:57.848522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ff81a-ce7a-4936-8c88-eab85286b4c8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:57.896901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44d29e-5236-4110-8990-6124f722ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:57.897861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d29e-5236-4110-8990-6124f722ea99 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:57.898228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d29e-5236-4110-8990-6124f722ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:57.898513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d29e-5236-4110-8990-6124f722ea99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:57.899846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44d29e-5236-4110-8990-6124f722ea99 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=d89ce6057b2843f2bfbc5a143eb9300e) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:57.900162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44d29e-5236-4110-8990-6124f722ea99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:57.901600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44d29e-5236-4110-8990-6124f722ea99 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:57.914624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 362/714] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:43:57 2022] GET /identity/v3/role_assignments?user.id=d89ce6057b2843f2bfbc5a143eb9300e&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:58.037640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66d72-2e21-4b7d-89c7-9a88fb43a5d9 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:58.038024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66d72-2e21-4b7d-89c7-9a88fb43a5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:58.038246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66d72-2e21-4b7d-89c7-9a88fb43a5d9 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:58.040001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 353/715] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:58.045902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cc37b-06ed-4a01-acf5-b962181de35d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:58.046442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cc37b-06ed-4a01-acf5-b962181de35d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:58.046442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cc37b-06ed-4a01-acf5-b962181de35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:58.067414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d22cc37b-06ed-4a01-acf5-b962181de35d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:58.068612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d22cc37b-06ed-4a01-acf5-b962181de35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:58.161407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 363/716] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:58.207349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66d72-2e21-4b7d-89c7-9a88fb43a5d9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:58.334291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66d72-2e21-4b7d-89c7-9a88fb43a5d9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:58.381431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:58.382264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:58.383160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:58.383446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] PATH_INFO: `/v3/services/network` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:58.384149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:58.385532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:58.397973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:58.399059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:58.400368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 354/717] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:43:58 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:58.407376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cc37b-06ed-4a01-acf5-b962181de35d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:58.513848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:58.545355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cc37b-06ed-4a01-acf5-b962181de35d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:58.591486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cc3a3-78d2-4d5d-86aa-39624bd2e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:58.592601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cc3a3-78d2-4d5d-86aa-39624bd2e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:58.593100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cc3a3-78d2-4d5d-86aa-39624bd2e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:58.593601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cc3a3-78d2-4d5d-86aa-39624bd2e0f9 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:58.594581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cc3a3-78d2-4d5d-86aa-39624bd2e0f9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:58.595120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cc3a3-78d2-4d5d-86aa-39624bd2e0f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:58.596776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cc3a3-78d2-4d5d-86aa-39624bd2e0f9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:58.606154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 364/718] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:43:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:58.611932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:58.677763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:58.786161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8adda-bde9-423c-b530-f6b533d47e3b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:58.821342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6292ba-44c6-4930-93f4-7dcd6da1dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:58.822043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6292ba-44c6-4930-93f4-7dcd6da1dc31 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:58.822328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6292ba-44c6-4930-93f4-7dcd6da1dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:58.822614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6292ba-44c6-4930-93f4-7dcd6da1dc31 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:58.823320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6292ba-44c6-4930-93f4-7dcd6da1dc31 None admin] RBAC: Adding query filter params (type=network) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:58.823629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6292ba-44c6-4930-93f4-7dcd6da1dc31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:58.825011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6292ba-44c6-4930-93f4-7dcd6da1dc31 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:58.830149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 355/719] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:43:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:59.092556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4a0b-2e8b-49e7-890c-4a90fa982b0b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:59.093045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4a0b-2e8b-49e7-890c-4a90fa982b0b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:59.093045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4a0b-2e8b-49e7-890c-4a90fa982b0b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:59.094442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 365/720] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:59.111535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf714-726e-4611-bc31-7bbe19ac6582 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:59.111865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf714-726e-4611-bc31-7bbe19ac6582 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:59.112118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf714-726e-4611-bc31-7bbe19ac6582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:59.134922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-48adf714-726e-4611-bc31-7bbe19ac6582 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:59.136133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-48adf714-726e-4611-bc31-7bbe19ac6582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:59.236793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 356/721] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:43:59.261782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e4a0b-2e8b-49e7-890c-4a90fa982b0b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:59.367945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e4a0b-2e8b-49e7-890c-4a90fa982b0b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:59.379477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea787de-9394-4e6a-b23e-346b15e35623 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:59.379988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea787de-9394-4e6a-b23e-346b15e35623 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:59.380069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea787de-9394-4e6a-b23e-346b15e35623 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:59.382497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 357/722] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:43:59.388927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1938b-c3b8-47d1-987c-e12620a49813 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:59.388927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1938b-c3b8-47d1-987c-e12620a49813 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:59.388927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1938b-c3b8-47d1-987c-e12620a49813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:59.410950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b1e1938b-c3b8-47d1-987c-e12620a49813 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:43:59.412157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b1e1938b-c3b8-47d1-987c-e12620a49813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:43:59.423622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:59.424443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:59.428012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:59.428304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:59.443899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:59.449266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:59.462125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:59.463541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:59.464509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:43:59.465340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:43:59.466936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 366/723] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:43:59.473279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:59.544986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 358/724] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 09:43:59.607883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1938b-c3b8-47d1-987c-e12620a49813 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:59.620791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf06c-89a5-4580-a186-00d7bbd549f8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:59.697952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:59.698992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:59.699484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:59.699987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:59.700967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:43:59.701502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:43:59.703103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:43:59.720352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 367/725] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:43:59.724289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:59.749050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1938b-c3b8-47d1-987c-e12620a49813 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:43:59.796383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:43:59.797573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:43:59.798339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:43:59.798858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:43:59.820500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:43:59.828606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:43:59.829611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:43:59.830507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:43:59.846468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 359/726] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:43:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:43:59.862181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:59.863387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:43:59.902214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:43:59.939883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e219-c6f8-45b6-97ba-616424b7278b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.005279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798109e-de01-4041-9239-5427c0e06869 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.013871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.014780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.015332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.015472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.042806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.043191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.043966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.044435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.044879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.045110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.046062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:00.046545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.048099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.058941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 360/727] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:43:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:00.064743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:00.085686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:00.086661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:00.087552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:00.087552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:00.087552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:00.087552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:00.091586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 368/728] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:00.095235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.178951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:00.207640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790916-29bf-4dae-ab6e-5aab63cff05b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.217868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d60e1-408c-43c8-b353-c92d7280a2ff None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.232012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:00.253292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fcbd7-dc4e-47a7-a276-2a529bb79948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.254118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fcbd7-dc4e-47a7-a276-2a529bb79948 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.254404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fcbd7-dc4e-47a7-a276-2a529bb79948 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.254684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fcbd7-dc4e-47a7-a276-2a529bb79948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.258451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3999d5d-7760-48d2-b8c5-3e03ed775195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.259106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999d5d-7760-48d2-b8c5-3e03ed775195 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.259393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999d5d-7760-48d2-b8c5-3e03ed775195 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.259674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999d5d-7760-48d2-b8c5-3e03ed775195 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.260400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999d5d-7760-48d2-b8c5-3e03ed775195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:00.260712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999d5d-7760-48d2-b8c5-3e03ed775195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.262160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999d5d-7760-48d2-b8c5-3e03ed775195 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.272450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fcbd7-dc4e-47a7-a276-2a529bb79948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.274520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fcbd7-dc4e-47a7-a276-2a529bb79948 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.275215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 369/729] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:00.276627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdcb52-53f9-41a7-a6e1-0713e159d4fe None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.276926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdcb52-53f9-41a7-a6e1-0713e159d4fe None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.277210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdcb52-53f9-41a7-a6e1-0713e159d4fe None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.283190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 370/730] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:00.283626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdcb52-53f9-41a7-a6e1-0713e159d4fe None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ef3fcbd7-dc4e-47a7-a276-2a529bb79948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:00.298093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:00.298996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:00.299895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:00.299895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:00.299895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:00.299895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:00.302654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 361/731] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:00.304060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706561-d4f5-4ff1-b81a-14aefb275c23 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.304544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706561-d4f5-4ff1-b81a-14aefb275c23 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.304977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706561-d4f5-4ff1-b81a-14aefb275c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.326904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1e706561-d4f5-4ff1-b81a-14aefb275c23 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:00.329851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1e706561-d4f5-4ff1-b81a-14aefb275c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:00.419510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 362/732] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:44:00.425887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdcb52-53f9-41a7-a6e1-0713e159d4fe None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.427099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706561-d4f5-4ff1-b81a-14aefb275c23 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.462017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.462817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.463104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.463383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.474104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.475916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:00.497789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:00.498819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:00.499765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 371/733] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:00.500351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.522794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:00.546137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:00.580434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706561-d4f5-4ff1-b81a-14aefb275c23 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.628974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.629652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.629983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.630264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.630992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:00.631246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055749d-bf96-4159-af09-6d581090df8d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.631380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.632715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.649381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 363/734] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:00.650583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.673677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.674530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.674894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.675182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.675910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.677288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.693668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 372/735] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:00 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:00.694784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.786050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296e337-49ee-4b03-8466-49db1a53923a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.815308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:00.829328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:00.844867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719ef04-939d-417c-aabd-f25ee4f48d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.846055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719ef04-939d-417c-aabd-f25ee4f48d2b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.846546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719ef04-939d-417c-aabd-f25ee4f48d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.847024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719ef04-939d-417c-aabd-f25ee4f48d2b None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.848070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719ef04-939d-417c-aabd-f25ee4f48d2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:00.848588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719ef04-939d-417c-aabd-f25ee4f48d2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.851048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719ef04-939d-417c-aabd-f25ee4f48d2b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.854395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52379a2e-72e0-4243-8cbf-e76b17ce2957 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:00.880239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 364/736] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 3 09:44:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:00.880239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d65fd-5e41-474f-b0a1-8697d861efb3 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.882306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d65fd-5e41-474f-b0a1-8697d861efb3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.883198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d65fd-5e41-474f-b0a1-8697d861efb3 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.885104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 365/737] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:00.885912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d65fd-5e41-474f-b0a1-8697d861efb3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:00.907047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3525f-93d9-4a62-b18a-ad7108d00295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:00.909098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3525f-93d9-4a62-b18a-ad7108d00295 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.909592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3525f-93d9-4a62-b18a-ad7108d00295 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.910697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3525f-93d9-4a62-b18a-ad7108d00295 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.920033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3525f-93d9-4a62-b18a-ad7108d00295 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:00.921503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3525f-93d9-4a62-b18a-ad7108d00295 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-05f3525f-93d9-4a62-b18a-ad7108d00295 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:00.937367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:00.938436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:00.939385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:00.939929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 373/738] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:44:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:00.941069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26297c68-0470-44f7-9514-da0b23414431 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:00.941360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26297c68-0470-44f7-9514-da0b23414431 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:00.941641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26297c68-0470-44f7-9514-da0b23414431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:00.960291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-26297c68-0470-44f7-9514-da0b23414431 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:00.962075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-26297c68-0470-44f7-9514-da0b23414431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:01.030403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d65fd-5e41-474f-b0a1-8697d861efb3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.040361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 374/739] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:44:01.041153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26297c68-0470-44f7-9514-da0b23414431 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.071547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.072299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.072661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.073016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.129863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:01.159380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:01.160858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:01.171901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:01.199112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26297c68-0470-44f7-9514-da0b23414431 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.249660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.251265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.251748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.252202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.253697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:01.254588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:01.256525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:01.285055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 375/740] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:01.285055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.290092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 366/741] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:44:01.291167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.386325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:01.410932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d42d1-bc7b-4700-8b35-5ebf9cf3ea20 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.420924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c8c87-6832-4523-b2ed-e22898f1d53a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.450747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.452050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.452645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.452993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.461587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:01.464488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.465354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.465968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.466481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.467256 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:01.477337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:01.478378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:01.479221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:01.481898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 376/742] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:01.482931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.548702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:01.550162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:01.607595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df90fa-ef27-4db6-9d76-5f7a998aa107 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.631940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:01.646253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.647621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.648764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.649263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.661134 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:01.666551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 367/743] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 09:44:01.666551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.667737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:01.685675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:01.686849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:01.687935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:01.687935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:01.687935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:01.687935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:01.687935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 377/744] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:01.688283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.746241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:01.771171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e8864-93a2-43b2-81c3-3742f2c54d2b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.802131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a743ec3-6b31-40f4-896b-fa18acb9c389 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.806069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cb3fb-c57c-40dc-a6a7-0354dbd3bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.806736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb3fb-c57c-40dc-a6a7-0354dbd3bde1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.807022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb3fb-c57c-40dc-a6a7-0354dbd3bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.807299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb3fb-c57c-40dc-a6a7-0354dbd3bde1 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.808037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb3fb-c57c-40dc-a6a7-0354dbd3bde1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:01.808405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb3fb-c57c-40dc-a6a7-0354dbd3bde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:01.809847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb3fb-c57c-40dc-a6a7-0354dbd3bde1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:01.818195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 368/745] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:01.819249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285f4a-b89d-45cf-b25e-03b22ae784e0 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.819552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285f4a-b89d-45cf-b25e-03b22ae784e0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.819821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285f4a-b89d-45cf-b25e-03b22ae784e0 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.821239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 369/746] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:01.825942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285f4a-b89d-45cf-b25e-03b22ae784e0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.845558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.846391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.847181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.847466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.862132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:01.862390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:01.863881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:01.881603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:01.883157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:01.884061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:01.884061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:01.884061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:01.884061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:01.884061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 378/747] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:01.884929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:01.942074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285f4a-b89d-45cf-b25e-03b22ae784e0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:01.977132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b619-5a6f-4813-9d1c-bc8c4bf5e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:01.977835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b619-5a6f-4813-9d1c-bc8c4bf5e9fb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.978123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b619-5a6f-4813-9d1c-bc8c4bf5e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.978402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b619-5a6f-4813-9d1c-bc8c4bf5e9fb None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:01.979116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b619-5a6f-4813-9d1c-bc8c4bf5e9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:01.979418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b619-5a6f-4813-9d1c-bc8c4bf5e9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:01.980921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b619-5a6f-4813-9d1c-bc8c4bf5e9fb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:01.993661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 370/748] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:01.994954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab06e5-a43f-4c3a-a9a2-6442b5e00f77 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:01.995249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab06e5-a43f-4c3a-a9a2-6442b5e00f77 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:01.995533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab06e5-a43f-4c3a-a9a2-6442b5e00f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.001128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce6786-3d0e-471f-8388-0ccb288cbae6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.003180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.016424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fdab06e5-a43f-4c3a-a9a2-6442b5e00f77 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:02.017604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fdab06e5-a43f-4c3a-a9a2-6442b5e00f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:02.043290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.044088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.044371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.044903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.055510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.056901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:02.073457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:02.074447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:02.075349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:02.075349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:02.075349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:02.075349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:02.075349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 379/749] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:02.075632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.105898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 371/750] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 09:44:02.107074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab06e5-a43f-4c3a-a9a2-6442b5e00f77 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.138494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.192699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df84ae-f880-4b1f-9e05-a98c6bd2d11f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.211481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab06e5-a43f-4c3a-a9a2-6442b5e00f77 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.229298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.230212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.230681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.231203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.232110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:02.232622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.234461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.246025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.246982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 380/751] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:02.247268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.247745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.247850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.248457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.258432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.260307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.266149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:02.278378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:02.279254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:02.280148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:02.280579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 372/752] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:02.281320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.359125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29a04-ecdf-44ae-b55e-d5c6887b5c32 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.375508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.397642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.398335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44932f13-7c6c-4e0c-a51f-47b56742baa3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.398448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.398625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.398908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.399676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:02.400149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.402352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.415837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 381/753] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:02.416928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.439218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.439891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.440178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.440458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.441176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.442593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.457609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 373/754] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:02 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:02.458717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.520599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.551653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656edad-6315-4af1-aa73-0b113b06a84c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.591842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83939932-37fa-4446-9396-8fe80b339fbe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.597288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.598142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.598429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.598712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.607300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.608895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:02.624714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:02.625739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:02.626683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 382/755] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:02.627178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.635319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.636446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.636916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.637371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.638392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:02.638998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.640922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.661004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 374/756] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:02.662517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.674129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.765633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c257662-1051-4d30-8db5-d1b7d9cf2927 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.798218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.802961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.803770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.804056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.804980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.805355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3e4c-f28e-480e-935a-0abc9abf3214 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.813502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.815135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:02.831119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:02.832094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:02.833488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 383/757] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:02.834130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.844165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:02.844837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:02.845126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:02.845409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:02.846576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:02.846900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:02.848389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:02.861579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 375/758] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:02.862458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:02.939684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:02.984231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fd168-1292-4ec4-891a-6b46cdf07a96 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:02.984522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade1419-e966-4e95-926a-fdb2cc884dd8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.040225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0d31e-f6ae-4b63-a83c-51233c5322ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.041343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0d31e-f6ae-4b63-a83c-51233c5322ed None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.041946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0d31e-f6ae-4b63-a83c-51233c5322ed None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.042555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0d31e-f6ae-4b63-a83c-51233c5322ed None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.044175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0d31e-f6ae-4b63-a83c-51233c5322ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:03.044840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0d31e-f6ae-4b63-a83c-51233c5322ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.045191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.045985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.046342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.046693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.047501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0d31e-f6ae-4b63-a83c-51233c5322ed None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.047723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=b7b8474647dd40b0add7fdba5f24e3a7) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:03.048052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.049544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.061869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 384/759] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/role_assignments?user.id=b7b8474647dd40b0add7fdba5f24e3a7&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:03.062907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.082753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 376/760] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:44:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:03.085200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cb8e-3717-4b93-a975-85159020c7b4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.086304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cb8e-3717-4b93-a975-85159020c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.086796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cb8e-3717-4b93-a975-85159020c7b4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.089796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 377/761] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:03.092743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cb8e-3717-4b93-a975-85159020c7b4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.136213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:03.189854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ec0f-8b6b-48ce-a6d2-9ad5f21054f1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.207639 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cb8e-3717-4b93-a975-85159020c7b4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.230654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:03.231822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe3781-099d-4d45-8e32-7e081d1f22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.233218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe3781-099d-4d45-8e32-7e081d1f22cc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.234698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe3781-099d-4d45-8e32-7e081d1f22cc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.234698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe3781-099d-4d45-8e32-7e081d1f22cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.235400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe3781-099d-4d45-8e32-7e081d1f22cc None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=12d8d367b1a84e0e98a3fcdb1c979d9b) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:03.235771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe3781-099d-4d45-8e32-7e081d1f22cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.237849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe3781-099d-4d45-8e32-7e081d1f22cc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.253793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 385/762] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/role_assignments?user.id=12d8d367b1a84e0e98a3fcdb1c979d9b&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:03.253793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d460-de99-4be8-983b-f19ac435259e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.253793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d460-de99-4be8-983b-f19ac435259e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.253793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d460-de99-4be8-983b-f19ac435259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.262051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.263816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.264106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.264390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.287814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2172d460-de99-4be8-983b-f19ac435259e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:03.289245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2172d460-de99-4be8-983b-f19ac435259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:03.292610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.294223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:03.327392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:03.328376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:03.329272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:03.329272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:03.329272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:03.329272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:03.329272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 378/763] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:03.334577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.447013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 386/764] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:03.494039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d460-de99-4be8-983b-f19ac435259e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.507072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed365146-e74b-4fe0-8918-6af7a5fb325e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.551650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.552329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.552625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.552889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.553617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:03.553733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:03.553950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.555495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.575210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 379/765] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:03.580782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.616168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d460-de99-4be8-983b-f19ac435259e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.622349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:03.656640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.657470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.657883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.658170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.658941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.660345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:03.676331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:03.677312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:44:03.678179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:03.682201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 387/766] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:03.684155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.693765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a16b-717c-4ccd-8e42-2351f922006c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.729249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.730006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.730295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.730579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.737562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.739072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:03.753299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:03.755390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:03.758037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 380/767] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:03.761787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.798561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62a0e-83e9-4815-9a94-17547219d7f5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.812690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:03.837634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.838339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.838680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.838965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.839816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:03.840132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.841684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.847328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 388/768] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:03.853407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.855134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:03.864197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fc32b-8c1e-426b-bbb1-1a9b50270dcb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:03.902408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:03.903143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:03.903439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:03.903719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:03.904525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:03.904837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:03.906500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:03.919274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 381/769] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:03.925000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:03.970723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1160f-496c-4f8a-baef-84bdc608ffbf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:04.008273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:04.008869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:04.009158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:04.009441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:04.010206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:04.010520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:04.012124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:04.018920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 389/770] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 3 09:44:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:04.024771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:04.031709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc901b-b338-4572-8a24-7288378ef5f4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:04.067725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:04.068617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:04.068900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:04.069179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/d89ce6057b2843f2bfbc5a143eb9300e/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:04.071341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=d89ce6057b2843f2bfbc5a143eb9300e, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:04.071909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:04.072899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:04.097625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 382/771] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:44:03 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/d89ce6057b2843f2bfbc5a143eb9300e/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:44:04.144358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe07dd6-c396-40be-be1b-f53ba92fbc40 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:04.182321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a018f57-e00c-46cf-8e5d-882cd0002170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:04.182997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a018f57-e00c-46cf-8e5d-882cd0002170 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:04.183288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a018f57-e00c-46cf-8e5d-882cd0002170 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:04.183572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a018f57-e00c-46cf-8e5d-882cd0002170 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:04.184382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a018f57-e00c-46cf-8e5d-882cd0002170 None admin] RBAC: Adding query filter params (interface=public, service_id=aed8349686df4115b5b0bdd42f1ff76d, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:04.184699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a018f57-e00c-46cf-8e5d-882cd0002170 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:04.186122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a018f57-e00c-46cf-8e5d-882cd0002170 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:04.194795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 390/772] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:44:04 2022] GET /identity/v3/endpoints?service_id=aed8349686df4115b5b0bdd42f1ff76d&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:04.201168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:04.228640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:04.346324 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd155d31-7f35-4d7e-836a-a0abb122d305 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:04.401870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba99273-08df-4ba9-bf8b-1974e6205f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:04.402548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba99273-08df-4ba9-bf8b-1974e6205f2d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:04.402833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba99273-08df-4ba9-bf8b-1974e6205f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:04.403112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba99273-08df-4ba9-bf8b-1974e6205f2d None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:04.403886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba99273-08df-4ba9-bf8b-1974e6205f2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:04.405271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba99273-08df-4ba9-bf8b-1974e6205f2d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:04.414999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 383/773] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:04 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:05.373334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3196d-c7ad-4dd4-a3c9-1b9b44515817 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:05.373888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3196d-c7ad-4dd4-a3c9-1b9b44515817 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:05.373969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3196d-c7ad-4dd4-a3c9-1b9b44515817 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:05.378490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 391/774] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:05.381181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d023f-18d4-4e99-af95-4820f92c101d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:05.381597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d023f-18d4-4e99-af95-4820f92c101d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:05.381814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d023f-18d4-4e99-af95-4820f92c101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:05.407145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bd0d023f-18d4-4e99-af95-4820f92c101d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:05.408356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bd0d023f-18d4-4e99-af95-4820f92c101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:05.517840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 384/775] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:05.553564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3196d-c7ad-4dd4-a3c9-1b9b44515817 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:05.687718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3196d-c7ad-4dd4-a3c9-1b9b44515817 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:05.690740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:05.739392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca97057-4f1d-4f4f-ac7f-3244fc32c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:05.740215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca97057-4f1d-4f4f-ac7f-3244fc32c13c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:05.740493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca97057-4f1d-4f4f-ac7f-3244fc32c13c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:05.740766 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca97057-4f1d-4f4f-ac7f-3244fc32c13c None admin] PATH_INFO: `/v3/services/network` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:05.741419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca97057-4f1d-4f4f-ac7f-3244fc32c13c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:05.743358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca97057-4f1d-4f4f-ac7f-3244fc32c13c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2ca97057-4f1d-4f4f-ac7f-3244fc32c13c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:05.755403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:05.756412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:05.757253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 392/776] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:05 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:05.762628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d023f-18d4-4e99-af95-4820f92c101d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:05.776668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:05.914367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d023f-18d4-4e99-af95-4820f92c101d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:05.949860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9a68-7880-4293-8d7b-88dfa586b670 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:05.949860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9a68-7880-4293-8d7b-88dfa586b670 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:05.949860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9a68-7880-4293-8d7b-88dfa586b670 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:05.950196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 393/777] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:05.956925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3827-003e-4689-bfd9-1d9b59a6cf79 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:05.957226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3827-003e-4689-bfd9-1d9b59a6cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:05.957512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3827-003e-4689-bfd9-1d9b59a6cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:05.967784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd34ca-a697-4636-9d63-5430210e08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:05.968448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd34ca-a697-4636-9d63-5430210e08f8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:05.968925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd34ca-a697-4636-9d63-5430210e08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:05.969208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd34ca-a697-4636-9d63-5430210e08f8 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:05.969939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd34ca-a697-4636-9d63-5430210e08f8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:05.970303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd34ca-a697-4636-9d63-5430210e08f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:05.971727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd34ca-a697-4636-9d63-5430210e08f8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:05.980865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 385/778] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:05.982199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efb369-3772-4eb5-be1f-4af064803dcf None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:05.982490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efb369-3772-4eb5-be1f-4af064803dcf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:05.982770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efb369-3772-4eb5-be1f-4af064803dcf None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:05.985069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 386/779] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:05.985858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efb369-3772-4eb5-be1f-4af064803dcf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:05.995096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9ddc3827-003e-4689-bfd9-1d9b59a6cf79 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:05.996290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9ddc3827-003e-4689-bfd9-1d9b59a6cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:06.068826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:06.079125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 394/780] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:06.080710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a7d8-d5dc-4e89-858e-b941283028da None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.081203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a7d8-d5dc-4e89-858e-b941283028da None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.081681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a7d8-d5dc-4e89-858e-b941283028da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.110090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efb369-3772-4eb5-be1f-4af064803dcf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.113652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f603a7d8-d5dc-4e89-858e-b941283028da None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:06.118978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f603a7d8-d5dc-4e89-858e-b941283028da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:06.150095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.150801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.151089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.151374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.152076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] RBAC: Adding query filter params (type=network) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:06.152388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:06.154163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:06.159810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 387/781] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:06.160877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.205862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 395/782] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:06.205862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a7d8-d5dc-4e89-858e-b941283028da None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.249171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:06.309190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5e51-a720-4a92-9564-b1597d362875 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.348001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.348218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a7d8-d5dc-4e89-858e-b941283028da None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.349297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.350056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.351419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.353562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:06.365279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:06.374063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:06.374994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:06.375819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 388/783] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:06.376527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.397471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.398245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.398590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.398866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.399661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] RBAC: Adding query filter params (interface=public, service_id=a77441e60a6d4eaca6328cf9bdbc7df7, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:06.399975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:06.401481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:06.407599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 396/784] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/endpoints?service_id=a77441e60a6d4eaca6328cf9bdbc7df7&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:06.408580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.509345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:06.516142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28968d9b-e7ac-452f-bc56-b5ff5afb3bed None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.520288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea1651-9404-465a-be61-f386c8e1f05d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.557738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.558608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.558896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.559176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.561472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.562784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.563270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.563757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.564990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:06.565495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:06.567722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:06.570333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:06.581282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:06.582253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:06.583089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:06.584529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 389/785] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:06.584926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 397/786] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:06.585932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.586882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.651160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:06.706733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8524196-9f21-4f54-9c93-8e5a324c90e3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.719481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d84945-7e9c-40d5-b641-e31e2a830825 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.757022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.757717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.758026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.758304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.758981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:06.760403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:06.765220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.766063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.766322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.766601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.770119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 390/787] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:06.771172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.779442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:06.780939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:06.800831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:06.801836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:06.802725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:06.802725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:06.802725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:06.802725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:06.806559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 398/788] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:06.807534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:06.817810 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:06.907382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f167c10-2f84-4d97-9138-2787b43312fb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:06.931330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:06.954182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14acfec-cba4-48dc-87d2-8878b062b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:06.955251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14acfec-cba4-48dc-87d2-8878b062b5be None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.955736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14acfec-cba4-48dc-87d2-8878b062b5be None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.956220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14acfec-cba4-48dc-87d2-8878b062b5be None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.957470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14acfec-cba4-48dc-87d2-8878b062b5be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:06.958023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14acfec-cba4-48dc-87d2-8878b062b5be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:06.959648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14acfec-cba4-48dc-87d2-8878b062b5be None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:06.972363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 391/789] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:06.974769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929981-7eac-4bfc-bc49-5bf24b887c06 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:06.975335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929981-7eac-4bfc-bc49-5bf24b887c06 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:06.975865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929981-7eac-4bfc-bc49-5bf24b887c06 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:06.977940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 392/790] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:06.978927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de929981-7eac-4bfc-bc49-5bf24b887c06 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.006631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a2efd-90fe-495a-8bd0-bebee4f311c3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.048600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7ab50-2db0-4fcf-bd1c-67675da93e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.048983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ab50-2db0-4fcf-bd1c-67675da93e44 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.049275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ab50-2db0-4fcf-bd1c-67675da93e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.049558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ab50-2db0-4fcf-bd1c-67675da93e44 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.050327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7ab50-2db0-4fcf-bd1c-67675da93e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:07.050709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7ab50-2db0-4fcf-bd1c-67675da93e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.052124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7ab50-2db0-4fcf-bd1c-67675da93e44 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.072094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 399/791] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:07.074526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0d13-64ca-4f2e-9504-12091caea7ba None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.075062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0d13-64ca-4f2e-9504-12091caea7ba None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.075634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0d13-64ca-4f2e-9504-12091caea7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.094433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f95a0d13-64ca-4f2e-9504-12091caea7ba None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:07.095614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f95a0d13-64ca-4f2e-9504-12091caea7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:07.096881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de929981-7eac-4bfc-bc49-5bf24b887c06 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.135066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.136293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.136956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.137425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.150609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.152554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:07.172608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:07.173543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:07.174906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:07.174906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:07.174906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:07.174906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:07.174906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 393/792] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:07.178128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.181784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:07.194145 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 400/793] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:07.195606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0d13-64ca-4f2e-9504-12091caea7ba None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.225009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:07.312480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0d13-64ca-4f2e-9504-12091caea7ba None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.312771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb320d5-d19c-4703-bfcc-4cbd54075c8b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.346675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9758e-28bf-472b-9652-889a13b647c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.346904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.347499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9758e-28bf-472b-9652-889a13b647c4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.347604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.347783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9758e-28bf-472b-9652-889a13b647c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.347879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.348066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9758e-28bf-472b-9652-889a13b647c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.348164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.348808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:07.349094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.350497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.355852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9758e-28bf-472b-9652-889a13b647c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.357303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9758e-28bf-472b-9652-889a13b647c4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.362197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 401/794] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:07.363166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-40f9758e-28bf-472b-9652-889a13b647c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:07.376141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:07.377111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:07.378099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:07.381166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 394/795] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:07.382861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28667-aaa5-4b30-ab08-52adb4cd77cd None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.383312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28667-aaa5-4b30-ab08-52adb4cd77cd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.383751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28667-aaa5-4b30-ab08-52adb4cd77cd None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.385634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 395/796] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:07.386506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28667-aaa5-4b30-ab08-52adb4cd77cd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.424929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:07.469400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf7ada-69f8-4f2f-9cff-8252aba7fb0c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.486539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:07.499623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28667-aaa5-4b30-ab08-52adb4cd77cd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.507345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.508146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.508435 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.508711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.520509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:07.528537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:07.529489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 402/797] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:07.530832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.540937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36b1e3-50f5-4d4f-a3bc-a65cfa66fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.542402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36b1e3-50f5-4d4f-a3bc-a65cfa66fc14 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.543257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36b1e3-50f5-4d4f-a3bc-a65cfa66fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.543690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36b1e3-50f5-4d4f-a3bc-a65cfa66fc14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.552928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36b1e3-50f5-4d4f-a3bc-a65cfa66fc14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.555197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36b1e3-50f5-4d4f-a3bc-a65cfa66fc14 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-cd36b1e3-50f5-4d4f-a3bc-a65cfa66fc14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:07.569468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:07.570540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:07.571483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 396/798] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:07.572435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b40d5-833b-46a9-bdad-e4fd9735d008 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.572435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b40d5-833b-46a9-bdad-e4fd9735d008 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.572435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b40d5-833b-46a9-bdad-e4fd9735d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.591390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f61b40d5-833b-46a9-bdad-e4fd9735d008 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:07.592589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f61b40d5-833b-46a9-bdad-e4fd9735d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:07.638567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94b9ca-7a37-4a5e-b4b2-64d9ed591df1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.656286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:07.671930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 397/799] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:07.672842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b40d5-833b-46a9-bdad-e4fd9735d008 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.684248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.685398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.685852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.686307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.687815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:07.688277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.690309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.710083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 403/800] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:07.711852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.760584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:07.779305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b40d5-833b-46a9-bdad-e4fd9735d008 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.814548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa5398-1fe7-4a4e-a118-51103afca00b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.816078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.816749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.817044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.817323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.818100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:07.818433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.819856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.832673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 398/801] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:07.832673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.856262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.856930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.857215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.857494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.858366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:07.858677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.860102 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.883267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 404/802] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:07.883267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:07.912550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:07.942284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382701e1-2a6b-4cc2-a2e3-5b0e33d8a747 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.977772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:07.978580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:07.978869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:07.979147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:07.979918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:07.981474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:07.985615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c21ca-bcd1-4150-a2c9-f351d1de4c23 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:07.994746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:07.995653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:07.996492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 399/803] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:07.997359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.010689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.029179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.030005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.030292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.030577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.040843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.042330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:08.060608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:08.061715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:08.062691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:08.062691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:08.062691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:08.062691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:08.062691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 405/804] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:08.062691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.111246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76edc6-6f5e-477c-871d-0dc5a1d2db7c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.146758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.147824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.148596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.148877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.160607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.160753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.162127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.178360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719811-e056-4d32-85f9-391b4dadd12c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:08.181361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:08.182428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:08.188002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:08.188002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:08.188002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:08.188002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:08.188002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 400/805] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:08.188002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.217462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.218408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.218809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.219108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.229452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.230684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:08.249267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:08.250188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:08.251081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:08.251081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:08.251081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:08.251081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:08.251081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 406/806] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:08.251775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.255216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.306241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907baa2d-4e67-4871-b79e-2651bdb4620f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.341918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.342589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.342877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.343556 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.344263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:08.344575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.346650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.351464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 401/807] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:08.356521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.367937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f95550-29fb-4f58-8543-6fdcee3a88ef None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.405133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.405819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.406111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.406390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.407109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:08.407416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.408798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.411129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.420631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 407/808] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:08.422640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.471423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372da44-bc84-4f13-8f11-96b56d6da4b4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.496506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.507661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.508322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.508609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.508945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.509666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:08.510005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.511383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.523513 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 402/809] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:08.524148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.548381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aba687-f4b2-4509-b43f-2d22e682fb13 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.585327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.586975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.587401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.587691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.588425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:08.588761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.590172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.607112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 408/810] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:08.607112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.635476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc4a0d-5adc-4824-a0e4-7b41d5e347a9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.666935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.670109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.670776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.671061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.671337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.672037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:08.672339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.673707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.679043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 403/811] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:08.679956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.719471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7878af-bdb9-4a43-8916-0cb834d010cb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.730081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.759323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.760517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.761009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.761573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.769003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.770807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.782773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912f2d-ba79-4196-b08e-5bc461233927 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:08.786455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:08.787333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 409/812] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:08.793113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.825161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.825988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.826273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.826551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.836221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.838271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:08.854290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:08.855473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:08.856443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 404/813] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:08.857027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.908517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe832f50-62be-4c7a-a736-66b214618c59 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.926604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:08.944011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:08.945331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:08.945622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:08.945930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:08.952671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:08.954171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:08.959855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0292be5-f0a2-49bb-8c9c-45c5ec26cc2c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:08.969657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:08.970551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:08.971439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 410/814] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:08.972829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:08.973269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:09.002163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.002816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.003105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.003601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.004111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.005480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:09.028347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 405/815] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:09.029251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:09.104207 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fc77b-53e4-4bcc-ae6c-6187e19ea988 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:09.165592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e891-39e3-45ff-ac7a-ade730723f43 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:09.167718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.168386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.168674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.168950 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.169736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:09.170073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.171565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:09.184669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 411/816] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:09.185534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:09.205638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032deb8-2f18-435a-ab8c-717b2f5b4239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.206694 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032deb8-2f18-435a-ab8c-717b2f5b4239 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.207126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032deb8-2f18-435a-ab8c-717b2f5b4239 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.207576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032deb8-2f18-435a-ab8c-717b2f5b4239 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.208641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032deb8-2f18-435a-ab8c-717b2f5b4239 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:09.208959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032deb8-2f18-435a-ab8c-717b2f5b4239 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.210528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032deb8-2f18-435a-ab8c-717b2f5b4239 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:09.223116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:09.229591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 406/817] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:44:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:09.230801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00e03-df67-435b-9a0b-3c785afa8c05 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.231096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00e03-df67-435b-9a0b-3c785afa8c05 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.231376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00e03-df67-435b-9a0b-3c785afa8c05 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.232601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 407/818] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:09.233273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f00e03-df67-435b-9a0b-3c785afa8c05 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:09.255112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:09.303826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf43a36-b622-4fcd-9988-a5edfca24338 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:09.342321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.342978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.343262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.343538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.344321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:09.344632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.346070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:09.357568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f00e03-df67-435b-9a0b-3c785afa8c05 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:09.363314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 412/819] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:09.363314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:09.399889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b5cd-d15a-4e51-b9f9-4d72062ff373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.400779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b5cd-d15a-4e51-b9f9-4d72062ff373 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.401065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b5cd-d15a-4e51-b9f9-4d72062ff373 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.401344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b5cd-d15a-4e51-b9f9-4d72062ff373 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/12d8d367b1a84e0e98a3fcdb1c979d9b/roles/3a6e3fdefefd4f8396998db7f4c9a9c5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.416984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b5cd-d15a-4e51-b9f9-4d72062ff373 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=12d8d367b1a84e0e98a3fcdb1c979d9b, role_id=3a6e3fdefefd4f8396998db7f4c9a9c5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.418462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b5cd-d15a-4e51-b9f9-4d72062ff373 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:09.432735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 408/820] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:44:09 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/12d8d367b1a84e0e98a3fcdb1c979d9b/roles/3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:44:09.434304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c306-0ed8-42e9-90e1-f6134eedfc2d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.434765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c306-0ed8-42e9-90e1-f6134eedfc2d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.435215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c306-0ed8-42e9-90e1-f6134eedfc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.453294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d8d2c306-0ed8-42e9-90e1-f6134eedfc2d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:09.454904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d8d2c306-0ed8-42e9-90e1-f6134eedfc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:09.481168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:09.492250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d817af-65de-49f9-94ed-1d59de2c4f41 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:09.535310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:09.535613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.537182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.537590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.537898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.543501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 409/821] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:09.545852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2c306-0ed8-42e9-90e1-f6134eedfc2d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:09.634843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.637405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:09.689266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2c306-0ed8-42e9-90e1-f6134eedfc2d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:09.731726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.732935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.733223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.733921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/b7b8474647dd40b0add7fdba5f24e3a7/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.736389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=b7b8474647dd40b0add7fdba5f24e3a7, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.738229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:09.747039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:09.755904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 413/822] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:09.756818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:09.756960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 410/823] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:44:09 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/b7b8474647dd40b0add7fdba5f24e3a7/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:44:09.761244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:09.879056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:09.930348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182994-efec-4378-8db0-2f14003f8f45 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:09.971630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:09.972359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:09.972647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:09.972927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:09.984609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:09.986302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.003078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a3fd-6be8-4293-82a2-e9567c36d80b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:10.005027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:10.005931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:10.006832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:10.006832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:10.006832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:10.006832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:10.006832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 411/824] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:10.014738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:10.044120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.045237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.045780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.046270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.047173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.048748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:10.061728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:10.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 09:44:10.063593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:10.066431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 414/825] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:09 2022] GET /identity/v3/services/network => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:10.074852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:10.143578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:10.194364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb2d4d-80c4-49d6-9acd-cab5d39b2832 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.210884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:10.212989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562b5e6-7d7c-4050-a644-e203a552e8b3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.258102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.258712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.259000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.259280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.260025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:10.260339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.261780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.281181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 412/826] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:10.282433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:10.285637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.286468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.286762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.287048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.287769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:10.288079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.290053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.297989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 415/827] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:10.303078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:10.433846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd096cc-9169-4718-a9c9-5750aea1a612 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.471638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404630-095e-424a-9a98-410df0d79dc8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.498178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.498984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.499268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.499547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.506272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:10.515912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.518832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.539113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.539834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.540118 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.540445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.541161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:10.541468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.542862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:10.548109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:10.548972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:10.549893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 413/828] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:10.553600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 416/829] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:10.556242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:10.559591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:10.606085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:10.686840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9109-39d3-4643-b7d3-ca030f7f0c99 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.704441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e8105-a757-40ba-a4df-6aae30019ac0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.738828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.739485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.739769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.740045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.740789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.742780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.764629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648415f-5a4b-40cc-8344-44071f6bdb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.765309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648415f-5a4b-40cc-8344-44071f6bdb42 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.765424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 417/830] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:44:10.765596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648415f-5a4b-40cc-8344-44071f6bdb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.765903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648415f-5a4b-40cc-8344-44071f6bdb42 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.766803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648415f-5a4b-40cc-8344-44071f6bdb42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:10.767064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648415f-5a4b-40cc-8344-44071f6bdb42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.768572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648415f-5a4b-40cc-8344-44071f6bdb42 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.800266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 414/831] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:10.807689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:10.876485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:10.934348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c627-0d95-4828-9d48-412276dde399 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:10.973362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce088f2d-1f75-4c7f-909a-5b5d844c912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:10.974431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088f2d-1f75-4c7f-909a-5b5d844c912c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:10.974926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088f2d-1f75-4c7f-909a-5b5d844c912c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:10.975406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088f2d-1f75-4c7f-909a-5b5d844c912c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:10.977030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce088f2d-1f75-4c7f-909a-5b5d844c912c None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=d89ce6057b2843f2bfbc5a143eb9300e) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:10.977564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce088f2d-1f75-4c7f-909a-5b5d844c912c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:10.979237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce088f2d-1f75-4c7f-909a-5b5d844c912c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:10.989452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 418/832] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:10 2022] GET /identity/v3/role_assignments?user.id=d89ce6057b2843f2bfbc5a143eb9300e&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:11.630002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b512-935e-4e86-bde9-87846e95ade0 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:11.630400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b512-935e-4e86-bde9-87846e95ade0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:11.630577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b512-935e-4e86-bde9-87846e95ade0 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:11.632193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 415/833] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:11.637463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377124d-4146-4000-99a3-ea0667562839 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:11.637775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377124d-4146-4000-99a3-ea0667562839 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:11.638073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377124d-4146-4000-99a3-ea0667562839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:11.655831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0377124d-4146-4000-99a3-ea0667562839 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:11.656929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0377124d-4146-4000-99a3-ea0667562839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:11.724638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 419/834] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:11.747053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7b512-935e-4e86-bde9-87846e95ade0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:11.849006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:11.867195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7b512-935e-4e86-bde9-87846e95ade0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:11.905780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:11.905780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:11.905780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:11.905780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:11.906252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:11.906252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:11.917894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:11.918913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:11.919762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 416/835] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:11.926963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377124d-4146-4000-99a3-ea0667562839 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:11.958701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:12.036388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377124d-4146-4000-99a3-ea0667562839 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:12.074213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c90b6e-5de9-41e8-afde-322821c58b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:12.075253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90b6e-5de9-41e8-afde-322821c58b98 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.075737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90b6e-5de9-41e8-afde-322821c58b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.076212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90b6e-5de9-41e8-afde-322821c58b98 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.077105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c90b6e-5de9-41e8-afde-322821c58b98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:12.077617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c90b6e-5de9-41e8-afde-322821c58b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:12.079199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c90b6e-5de9-41e8-afde-322821c58b98 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:12.084575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 420/836] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:12.090763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.126309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfabda-095e-4921-b378-62114b377784 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.126947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfabda-095e-4921-b378-62114b377784 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.127440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfabda-095e-4921-b378-62114b377784 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.129348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 421/837] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:12.134461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f980b-4f7e-482d-9105-6050107b8477 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.134748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f980b-4f7e-482d-9105-6050107b8477 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.135028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f980b-4f7e-482d-9105-6050107b8477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.152883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0e1f980b-4f7e-482d-9105-6050107b8477 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:12.154193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0e1f980b-4f7e-482d-9105-6050107b8477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:12.219233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeff781-d6af-4cc6-b4a5-cc521529c508 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:12.233771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 422/838] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:12.251000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f980b-4f7e-482d-9105-6050107b8477 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.265154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73faec-1608-42a8-b2c4-a03b0a158c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:12.266409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73faec-1608-42a8-b2c4-a03b0a158c52 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.266897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73faec-1608-42a8-b2c4-a03b0a158c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.267862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73faec-1608-42a8-b2c4-a03b0a158c52 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.269059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73faec-1608-42a8-b2c4-a03b0a158c52 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:12.269829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73faec-1608-42a8-b2c4-a03b0a158c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:12.273237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73faec-1608-42a8-b2c4-a03b0a158c52 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:12.278054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:12.282374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 417/839] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:12.302440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0c70-d185-4bf0-a31e-3f2e814f5b18 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.302803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0c70-d185-4bf0-a31e-3f2e814f5b18 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.303012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0c70-d185-4bf0-a31e-3f2e814f5b18 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.304884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 418/840] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:12.310804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb961f-bc88-4e02-bd3a-b3817868bfa2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.311119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb961f-bc88-4e02-bd3a-b3817868bfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.311377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb961f-bc88-4e02-bd3a-b3817868bfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.334246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-69bb961f-bc88-4e02-bd3a-b3817868bfa2 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:12.336007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-69bb961f-bc88-4e02-bd3a-b3817868bfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:12.357645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:12.391654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f980b-4f7e-482d-9105-6050107b8477 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:12.433367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:12.434023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 419/841] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:12.434963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.435322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.435668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.454531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:12.457580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb961f-bc88-4e02-bd3a-b3817868bfa2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:12.464213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:12.465214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:12.466323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 423/842] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:12.472539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.569588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:12.586664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb961f-bc88-4e02-bd3a-b3817868bfa2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:12.590445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e3679-2a53-441f-b65c-abd393d9fc95 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:12.625493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:12.626284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.626658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.627010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.627825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:12.628219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:12.629564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:12.629697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:12.630669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.631127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.631573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.643784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 424/843] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:12.644772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.648148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:12.658016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:12.659011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:12.659846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 420/844] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:12.665644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.681362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:12.774445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01549c7-92ff-42ff-b628-5edf35bbdc01 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:12.802814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf9c1-0e6f-4326-887b-ecdf3a56ff36 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:12.818523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:12.819576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.820184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.820609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.839392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:12.841345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:12.842796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:12.843544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:12.843758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:12.844040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:12.844992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:12.845109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:12.846477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:12.849939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:12.861352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 421/845] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:12.862281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:12.864765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:12.865805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:12.866948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:12.866948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:12.866948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:12.866948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:12.874876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 425/846] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:12.875938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:12.941839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:12.982904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c95e-777b-4343-8f1a-dcfe71600036 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.003662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937b46a-f852-4cd0-a9a1-668ed30d6215 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.029798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.030940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.031605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.032418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.040778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.041600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.041984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.042403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.043270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:13.043693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.045180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.046859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.048988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.063969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 426/847] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:13.065041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:13.070884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:13.071940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:13.073025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:13.073025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:13.073025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:13.073025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:13.074864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 422/848] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:13.080470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.161949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.197609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11eca4-95e4-49eb-af2e-f5bb00f802c7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.208795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d42f6-e66f-445d-bd5f-dd1c774fb371 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.221700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.236244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.237223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.237710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.238226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.239165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:13.239684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.241250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.246127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.246939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.247229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.247513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.255205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.260372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.260491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 423/849] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:13.261453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:13.278995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:13.279993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:13.280944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:13.284857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 427/850] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:13.285914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.369619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad216e-a8e6-49ce-9c5b-71f166237cc0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.394583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b0dae-1421-4843-8a94-0303f1bb6f94 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.406813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.407538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.407890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.408233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.416580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.416718 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.418219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:13.434888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:13.436153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 09:44:13.437326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:13.441619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 424/851] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:13.442434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.443112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.443398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.443684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.444530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:13.445383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.446736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.446859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.471199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 428/852] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:13.472482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.496644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.562932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045387-f499-42b9-9d75-6f39b8070c87 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.582850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a49130-ca52-44f9-af07-c20b4c9724f6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.598502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beddf2f-cba5-490f-9739-bec2865fd21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.599192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beddf2f-cba5-490f-9739-bec2865fd21c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.599501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beddf2f-cba5-490f-9739-bec2865fd21c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.599753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beddf2f-cba5-490f-9739-bec2865fd21c None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.600593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beddf2f-cba5-490f-9739-bec2865fd21c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:13.600909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beddf2f-cba5-490f-9739-bec2865fd21c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.602935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beddf2f-cba5-490f-9739-bec2865fd21c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.622710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 425/853] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:13.622710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d923-be5f-4b9d-8b27-5b84af5bb6a7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.622710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d923-be5f-4b9d-8b27-5b84af5bb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.622710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d923-be5f-4b9d-8b27-5b84af5bb6a7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.622710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 426/854] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:13.630694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca69bc-7e31-4f54-a9c3-33642bf6dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.630973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179d923-be5f-4b9d-8b27-5b84af5bb6a7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.631358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca69bc-7e31-4f54-a9c3-33642bf6dee9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.631632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca69bc-7e31-4f54-a9c3-33642bf6dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.631915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca69bc-7e31-4f54-a9c3-33642bf6dee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.681341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.705564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca69bc-7e31-4f54-a9c3-33642bf6dee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.707566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca69bc-7e31-4f54-a9c3-33642bf6dee9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.735110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.740095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179d923-be5f-4b9d-8b27-5b84af5bb6a7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:13.780921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:13.781571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.781904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.782187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.809789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 429/855] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:13.815641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c2ff2-3e71-4a04-835c-8a8bce057c95 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:13.815878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c2ff2-3e71-4a04-835c-8a8bce057c95 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:13.816164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c2ff2-3e71-4a04-835c-8a8bce057c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:13.832720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b60c2ff2-3e71-4a04-835c-8a8bce057c95 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:13.833929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b60c2ff2-3e71-4a04-835c-8a8bce057c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:13.852855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:13.854347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:13.905830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 430/856] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:13.906687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c2ff2-3e71-4a04-835c-8a8bce057c95 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:13.914912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.979570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:13.983531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 427/857] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:13.984634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.017246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c2ff2-3e71-4a04-835c-8a8bce057c95 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.053311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.055039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.055523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.055799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.067615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.069011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:14.087086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:14.088015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:14.088925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:14.088925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:14.088925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:14.088925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:14.088925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 431/858] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:14.089741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.091824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc6634-8863-4d7f-a348-6264cb516a1b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.128709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.129673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.129998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.131047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.131702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.133142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:14.150471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:14.151477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:14.157793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 428/859] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Jun 3 09:44:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:14.158853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.159391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:14.203479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6cca-03e0-4299-8418-de79ff3677f4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.227832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:14.240016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.240812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.241093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.241372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.252255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.253734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.270953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8acecd-4ef4-4fd1-87e1-525951690d97 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:14.272978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:14.273895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:14.274833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:14.274833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:14.274833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:14.274833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:14.279209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 432/860] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:14.279981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.313276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.314035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.314321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.314667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.315313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:14.315623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.317001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.334026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 429/861] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:14.334026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.397594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e88921-080f-464b-8b63-aef9145e6883 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.408582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:14.434948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.435614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.435902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.436183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.436891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:14.437204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.438698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.443356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f637b43-d71f-4904-acec-82585d936c4e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.448889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 433/862] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:14.449646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.468149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:14.480546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.481209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.481499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.481803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.482527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:14.482847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.484202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.496258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 430/863] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:14.497055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.565873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece91866-ef5f-47f2-b034-a81cddf60e0e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.602060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.602774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.603059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.603336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.608143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59987-ccf8-4c84-9759-699df69c876d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.610131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.611585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:14.625622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:14.626568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:14.627473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 434/864] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:14.627971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.643164 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fb1e5-23b1-440c-93f2-1b8aea06c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.643828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fb1e5-23b1-440c-93f2-1b8aea06c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.644106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fb1e5-23b1-440c-93f2-1b8aea06c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.644382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fb1e5-23b1-440c-93f2-1b8aea06c9c6 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.645069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fb1e5-23b1-440c-93f2-1b8aea06c9c6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:14.645371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fb1e5-23b1-440c-93f2-1b8aea06c9c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.646772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fb1e5-23b1-440c-93f2-1b8aea06c9c6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.651798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 431/865] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:14.652978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771389d-924e-475d-a9ba-218ab4b324b8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.653264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771389d-924e-475d-a9ba-218ab4b324b8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.653541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771389d-924e-475d-a9ba-218ab4b324b8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.656412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 432/866] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:14.657267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771389d-924e-475d-a9ba-218ab4b324b8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.671168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:14.713015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:14.749141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bfb66-4fb3-4d9e-ac20-d804e81de9f9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.777845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771389d-924e-475d-a9ba-218ab4b324b8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.789087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a149b-318c-4cec-a729-08ea6e9266fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.790273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a149b-318c-4cec-a729-08ea6e9266fa None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.790651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a149b-318c-4cec-a729-08ea6e9266fa None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.790893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a149b-318c-4cec-a729-08ea6e9266fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.798567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a149b-318c-4cec-a729-08ea6e9266fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.800077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a149b-318c-4cec-a729-08ea6e9266fa None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.815553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-e74a149b-318c-4cec-a729-08ea6e9266fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:14.815824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:14.816977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:14.817913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 435/867] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:14.818440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42bdb9-ec8e-47bf-9f70-925705b07a76 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.818866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42bdb9-ec8e-47bf-9f70-925705b07a76 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.818967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42bdb9-ec8e-47bf-9f70-925705b07a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.819966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:14.820457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:14.820742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:14.821558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:14.821907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:14.823513 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:14.837499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 433/868] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:14.838408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.840388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cd42bdb9-ec8e-47bf-9f70-925705b07a76 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:14.841784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cd42bdb9-ec8e-47bf-9f70-925705b07a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:14.921835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 436/869] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:14.921835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42bdb9-ec8e-47bf-9f70-925705b07a76 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:14.945475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:14.962235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aab6e7-a764-49e7-b72f-ac9d8d9bd646 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:14.972075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:15.002202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:15.003249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:15.003249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:15.003548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:15.004417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:15.004554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:15.005939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:15.018906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 434/870] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:15.019748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:15.040787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42bdb9-ec8e-47bf-9f70-925705b07a76 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:15.079271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:15.079927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:15.080219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:15.080503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:15.081333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=12d8d367b1a84e0e98a3fcdb1c979d9b) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:15.081651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:15.083140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:15.097785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 437/871] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:14 2022] GET /identity/v3/role_assignments?user.id=12d8d367b1a84e0e98a3fcdb1c979d9b&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:15.097785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:15.135017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b6702-f53c-4a19-8898-290a0dc2400e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:15.195201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7824c-b457-4c24-8e53-77f8aef4e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:15.196093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7824c-b457-4c24-8e53-77f8aef4e2b8 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:15.196495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7824c-b457-4c24-8e53-77f8aef4e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:15.196943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7824c-b457-4c24-8e53-77f8aef4e2b8 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:15.197951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7824c-b457-4c24-8e53-77f8aef4e2b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:15.200253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7824c-b457-4c24-8e53-77f8aef4e2b8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:15.213991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:15.221795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 435/872] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:15 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:15.235602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fe97a-072d-4e8f-9f99-ec66269206de None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:15.290386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b0206-91ba-4cde-9db3-7c0cf518cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:15.291654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0206-91ba-4cde-9db3-7c0cf518cc3e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:15.292179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0206-91ba-4cde-9db3-7c0cf518cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:15.292762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0206-91ba-4cde-9db3-7c0cf518cc3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:15.293975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b0206-91ba-4cde-9db3-7c0cf518cc3e None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=b7b8474647dd40b0add7fdba5f24e3a7) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:15.294547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b0206-91ba-4cde-9db3-7c0cf518cc3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:15.296464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b0206-91ba-4cde-9db3-7c0cf518cc3e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:15.305166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 438/873] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:15 2022] GET /identity/v3/role_assignments?user.id=b7b8474647dd40b0add7fdba5f24e3a7&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:16.938892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac490e-c328-4100-9323-4b726ed100c6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:16.939453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac490e-c328-4100-9323-4b726ed100c6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:16.939727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac490e-c328-4100-9323-4b726ed100c6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:16.941206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 436/874] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:16.948148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb97f7-0bba-4e86-916b-65a20451b814 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:16.948592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb97f7-0bba-4e86-916b-65a20451b814 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:16.948779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb97f7-0bba-4e86-916b-65a20451b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:16.965995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b2eb97f7-0bba-4e86-916b-65a20451b814 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:16.967180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b2eb97f7-0bba-4e86-916b-65a20451b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:17.044389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 439/875] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:17.067430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac490e-c328-4100-9323-4b726ed100c6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:17.096896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:17.183156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac490e-c328-4100-9323-4b726ed100c6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:17.220562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae18041-3788-42e8-b0f8-08c5233ee6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:17.221166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae18041-3788-42e8-b0f8-08c5233ee6c1 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.221474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae18041-3788-42e8-b0f8-08c5233ee6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.221732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae18041-3788-42e8-b0f8-08c5233ee6c1 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.222526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae18041-3788-42e8-b0f8-08c5233ee6c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:17.224026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae18041-3788-42e8-b0f8-08c5233ee6c1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:17.244172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 437/876] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:17 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:17.573392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c7a3-5604-4f15-8e23-b152e3d0334b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.573844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c7a3-5604-4f15-8e23-b152e3d0334b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.574256 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c7a3-5604-4f15-8e23-b152e3d0334b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.575984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 440/877] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:17.581411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befcc02-018e-43f0-9c1e-8959801019d2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.581712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befcc02-018e-43f0-9c1e-8959801019d2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.582032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befcc02-018e-43f0-9c1e-8959801019d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.601028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5befcc02-018e-43f0-9c1e-8959801019d2 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:17.602266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5befcc02-018e-43f0-9c1e-8959801019d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:17.617036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3482ae-67ff-476e-afb5-c05f55f15df0 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.617668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3482ae-67ff-476e-afb5-c05f55f15df0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.618220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3482ae-67ff-476e-afb5-c05f55f15df0 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.621244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 441/878] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:17.625721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2876c3-9a1f-42c7-a845-b92c1489e411 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.626304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2876c3-9a1f-42c7-a845-b92c1489e411 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.626790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2876c3-9a1f-42c7-a845-b92c1489e411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.643834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-db2876c3-9a1f-42c7-a845-b92c1489e411 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:17.645398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-db2876c3-9a1f-42c7-a845-b92c1489e411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:17.685852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 438/879] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:17.687142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e34f-2f56-49dd-9975-7cb4a5b9b0d3 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.687435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e34f-2f56-49dd-9975-7cb4a5b9b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.687715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e34f-2f56-49dd-9975-7cb4a5b9b0d3 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.689133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 439/880] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:17.694225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32fb5a-a97a-4cf4-8d88-6858ec1d2d58 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.694520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32fb5a-a97a-4cf4-8d88-6858ec1d2d58 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.694836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32fb5a-a97a-4cf4-8d88-6858ec1d2d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.713194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eb32fb5a-a97a-4cf4-8d88-6858ec1d2d58 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:17.714420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eb32fb5a-a97a-4cf4-8d88-6858ec1d2d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:17.724491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:17.730069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 442/881] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:17.731288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2876c3-9a1f-42c7-a845-b92c1489e411 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:17.743185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:17.803701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 440/882] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:17.804370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32fb5a-a97a-4cf4-8d88-6858ec1d2d58 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:17.844298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2876c3-9a1f-42c7-a845-b92c1489e411 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:17.881092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:17.881927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.882281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.882563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.893897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:17.903119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:17.904089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:17.904994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 443/883] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 3 09:44:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:17.905721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:17.912616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32fb5a-a97a-4cf4-8d88-6858ec1d2d58 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:17.950707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:17.951823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:17.952111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:17.952540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:17.953195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:17.954634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:17.966844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:17.967886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:17.969330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 441/884] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:17.970211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:17.981095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:17.983121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:18.014692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378200-ebb0-454f-a578-6f1397bf732f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.048363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.049167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.049451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.049729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.050414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.051795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:18.063715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:18.064728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:18.065589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 444/885] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:18.067024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.086944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07af447-5efb-4e21-b6d3-320d650b78b2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.124231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.125327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.125867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.126364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.127166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:18.127469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.129064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.142082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 442/886] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 3 09:44:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:18.142082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.168235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4bbe-7d95-47ec-8cf2-ff4b8d22259a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.197872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:18.203275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.203939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.204218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.204501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.205206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:18.205510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.207188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.211802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 445/887] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:18.212567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.219615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:18.252286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36305-907a-4309-afdc-54848a88f4ec None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.288067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.289254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.289536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.289838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.290539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:18.290847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.292214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.301522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 443/888] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:18.301522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.328485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209809-a1eb-4bdb-9965-f46a327397cc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.362891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.363767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.364063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.364345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.375172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.376590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:18.403219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:18.404142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:18.409699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:18.409699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:18.409699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:18.409699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:18.409699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 446/889] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:18.409699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.423286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe333-a6bb-4ff1-a1fe-d8e4510cab95 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.457585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.458285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.458574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.458856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.459558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:18.459863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.461806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.463099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:18.465322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:18.467916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 444/890] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:18.468637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.525595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b61b3-44a7-4b04-844e-3ad6de615de5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.561495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.562162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.562445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.562721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.563558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:18.563969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.565311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.569501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493793b-70fb-4199-9d17-9f1d95575375 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.577941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 447/891] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:18.577941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.616099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.617259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.617542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.617960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.618689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:18.618994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.620397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.635727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 445/892] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:18.640670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.703041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0359ba1-91ce-44a4-8605-c51b4851a3f3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.719097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:18.724314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:18.746923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.747885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.748332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.748764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.749890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] RBAC: Adding query filter params (interface=public, service_id=b3443b748f084b719a2c5249b5a9054c, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:18.750365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.751903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.759157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 448/893] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/endpoints?service_id=b3443b748f084b719a2c5249b5a9054c&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:18.767541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.782666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed29bd-01b7-43df-a83a-e3b0447b1bd6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.822278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.823253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.823634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.824006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.831658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.833185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:18.849073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:18.850204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:18.851476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 446/894] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:18.856600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:18.881001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce786b-a277-4774-a14d-1d98fa41b326 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.924922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:18.925951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:18.926430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:18.927120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:18.928565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:18.930623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:18.946346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 449/895] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:44:18.972804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298fa8e-29d3-499a-9869-a2b10eccbf82 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:18.993590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:19.013340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:19.014053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.014341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.014620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.015533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:19.015847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:19.017377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:19.050085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 447/896] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 3 09:44:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:19.061819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:19.103586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:19.173395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe54bfa-3ac8-4efe-99b2-4a590b6761e5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:19.211449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e142668-e488-40ee-8f5a-c5b7eb52e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:19.212133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142668-e488-40ee-8f5a-c5b7eb52e684 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.212408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142668-e488-40ee-8f5a-c5b7eb52e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.212721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142668-e488-40ee-8f5a-c5b7eb52e684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.288679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e142668-e488-40ee-8f5a-c5b7eb52e684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:19.290168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e142668-e488-40ee-8f5a-c5b7eb52e684 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:19.331503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:19.395110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 450/897] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:19 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:19.401156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:19.505862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e48900-50a5-4e3c-8eea-2d3ed239eb66 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:19.542638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:19.543813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.544305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.544789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.555613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:19.557379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:19.561109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943849-f59b-40e9-8bd7-3e48548f7862 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.561411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943849-f59b-40e9-8bd7-3e48548f7862 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.561695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943849-f59b-40e9-8bd7-3e48548f7862 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.563387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 451/898] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:19.568448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8624ea-a09c-4fde-b64e-c6c49b4b5436 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.568746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8624ea-a09c-4fde-b64e-c6c49b4b5436 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.569020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8624ea-a09c-4fde-b64e-c6c49b4b5436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:19.578011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:19.578902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:19.579811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:19.579811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:19.579811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:19.579811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:19.579811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 448/899] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:19.586799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:19.587078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-da8624ea-a09c-4fde-b64e-c6c49b4b5436 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:19.588248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-da8624ea-a09c-4fde-b64e-c6c49b4b5436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:19.619377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:19.668859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 452/900] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:19.696578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8624ea-a09c-4fde-b64e-c6c49b4b5436 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:19.720762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7126-5d7f-462a-8dde-02931ecdce9a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:19.776415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:19.777306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:19.778122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.779787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.780514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.781604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:19.782161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:19.783760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:19.801813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 449/901] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:19.807683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:19.823184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8624ea-a09c-4fde-b64e-c6c49b4b5436 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:19.876233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:19.877623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.878146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.878608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.879461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:19.881921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:19.899738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:19.900742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:19.901583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:19.905797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 453/902] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Jun 3 09:44:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:19.909219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:19.910681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:19.929004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d450f-83f8-4a38-8ba5-82191cdb75ea None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:19.973996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:19.976652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:19.977160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:19.977978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:19.987946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:19.989682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:20.008919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:20.010083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:20.011168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:20.013797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 450/903] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:20.022687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:20.036019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc562f-6a80-414d-9d98-3eb9fbad008b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:20.077266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:20.078106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:20.078692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:20.079219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:20.080041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:20.080444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:20.082546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:20.083959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:20.094771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 454/904] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:20.096546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:20.152992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ac985-5571-4eaf-a3dc-58704e6ef7de None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:20.203172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:20.204154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:20.204589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:20.205453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:20.206732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:20.207212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:20.209386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:20.218034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ccf2-9008-4d02-9965-d35f4a530749 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:20.226090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 451/905] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:20.233925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:20.249467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:20.256055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:20.256937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:20.257914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:20.258331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:20.259213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:20.259655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:20.261173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:20.266918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 455/906] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:20.272117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:20.338173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:20.372553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760217-9122-4b41-bb1f-03b235c31b36 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:20.381289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6833fc2-ad97-4aed-950e-e9689921e401 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:20.418097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e57a6-1cd8-460d-af4d-eac076634d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:20.418969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e57a6-1cd8-460d-af4d-eac076634d19 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:20.419355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e57a6-1cd8-460d-af4d-eac076634d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:20.419469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:20.419806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e57a6-1cd8-460d-af4d-eac076634d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:20.420411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:20.420831 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e57a6-1cd8-460d-af4d-eac076634d19 None admin] RBAC: Adding query filter params (role.id=ad0b575d79cd4ff19d7b15c7dec12940, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=12d8d367b1a84e0e98a3fcdb1c979d9b) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:20.420994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:20.421314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e57a6-1cd8-460d-af4d-eac076634d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:20.421563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:20.422539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] RBAC: Adding query filter params (interface=public, service_id=a6dd854aff4c4ca7a5f0f7327722acbd, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:20.423053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:20.423164 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e57a6-1cd8-460d-af4d-eac076634d19 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:20.424691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:20.431060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 456/908] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:44:20 2022] GET /identity/v3/endpoints?service_id=a6dd854aff4c4ca7a5f0f7327722acbd&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:20.433830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 452/908] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:20 2022] GET /identity/v3/role_assignments?user.id=12d8d367b1a84e0e98a3fcdb1c979d9b&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=ad0b575d79cd4ff19d7b15c7dec12940 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:20.436311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:20.552140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811587-b345-40ad-bdb1-4bfd41313ece None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:20.581635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:20.591994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201869e-c114-4879-8974-4bc7308fdbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:20.592650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201869e-c114-4879-8974-4bc7308fdbba None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:20.592937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201869e-c114-4879-8974-4bc7308fdbba None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:20.593216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201869e-c114-4879-8974-4bc7308fdbba None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:20.593992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201869e-c114-4879-8974-4bc7308fdbba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:20.595397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201869e-c114-4879-8974-4bc7308fdbba None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:20.602876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 457/909] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:20 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:44:21.009783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c3ef-12a0-42cc-8d39-977ec2e43af8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.010455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c3ef-12a0-42cc-8d39-977ec2e43af8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.010561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c3ef-12a0-42cc-8d39-977ec2e43af8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:21.012399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 453/910] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:21.018536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c255-1157-48f7-9076-f117e8db71e5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.019071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c255-1157-48f7-9076-f117e8db71e5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.019536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c255-1157-48f7-9076-f117e8db71e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:21.037868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9455c255-1157-48f7-9076-f117e8db71e5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:21.039903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9455c255-1157-48f7-9076-f117e8db71e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:21.113853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 458/911] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:21.132499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c3ef-12a0-42cc-8d39-977ec2e43af8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:21.211552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:21.250946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c3ef-12a0-42cc-8d39-977ec2e43af8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:21.286787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dca91-1c96-4cc7-9e5d-9e4400295e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:21.287380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dca91-1c96-4cc7-9e5d-9e4400295e76 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.287666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dca91-1c96-4cc7-9e5d-9e4400295e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.287946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dca91-1c96-4cc7-9e5d-9e4400295e76 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:21.288720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dca91-1c96-4cc7-9e5d-9e4400295e76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:21.290137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dca91-1c96-4cc7-9e5d-9e4400295e76 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:21.307550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 454/912] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:21 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:21.391181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eb5d0-b970-40ca-aa5a-fa9717366ef8 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.393706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eb5d0-b970-40ca-aa5a-fa9717366ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.394330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eb5d0-b970-40ca-aa5a-fa9717366ef8 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:21.396392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 459/913] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:21.402645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a8a6-11aa-4dac-a02c-cb4a0696932a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.402962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a8a6-11aa-4dac-a02c-cb4a0696932a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.403284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a8a6-11aa-4dac-a02c-cb4a0696932a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:21.422013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b579a8a6-11aa-4dac-a02c-cb4a0696932a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:21.423274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b579a8a6-11aa-4dac-a02c-cb4a0696932a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:21.505370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 455/914] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:21.528812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eb5d0-b970-40ca-aa5a-fa9717366ef8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:21.636039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eb5d0-b970-40ca-aa5a-fa9717366ef8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:21.657973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:21.672906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:21.673689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.674005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.674284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:21.674942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:21.676322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:21.688869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:21.689955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:21.691219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 460/915] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:21.696576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579a8a6-11aa-4dac-a02c-cb4a0696932a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:21.766150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:21.802008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579a8a6-11aa-4dac-a02c-cb4a0696932a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:21.838409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:21.839079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.839366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.839640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:21.840342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:21.840647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:21.842082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:21.847285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 456/916] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:21.853355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:21.963619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c31e-cc94-45dd-a492-58e6d5401846 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:21.998153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18775b10-2afd-4c75-850b-19c02486ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:21.998821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775b10-2afd-4c75-850b-19c02486ae2d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:21.999106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775b10-2afd-4c75-850b-19c02486ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:21.999384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775b10-2afd-4c75-850b-19c02486ae2d None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:22.000162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18775b10-2afd-4c75-850b-19c02486ae2d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:22.000470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18775b10-2afd-4c75-850b-19c02486ae2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:22.001922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18775b10-2afd-4c75-850b-19c02486ae2d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:22.007910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 461/917] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Jun 3 09:44:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:22.013427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:22.115600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ff863-c6f3-440b-a00a-66e46e810380 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:22.138845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:22.152993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a48dd-d0f7-49f8-aa29-9f516ee0ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:22.153652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a48dd-d0f7-49f8-aa29-9f516ee0ffcb None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:22.153968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a48dd-d0f7-49f8-aa29-9f516ee0ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:22.154250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a48dd-d0f7-49f8-aa29-9f516ee0ffcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:22.155001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a48dd-d0f7-49f8-aa29-9f516ee0ffcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:22.156379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a48dd-d0f7-49f8-aa29-9f516ee0ffcb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:22.179670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 457/918] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:22.742873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd915f-2e57-4d54-a36a-e7758112b894 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:22.743416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd915f-2e57-4d54-a36a-e7758112b894 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:22.743416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd915f-2e57-4d54-a36a-e7758112b894 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:22.745054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 462/919] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:22.750214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96cd8e-47c4-4ca1-bf47-18517842e951 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:22.750725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96cd8e-47c4-4ca1-bf47-18517842e951 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:22.751208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96cd8e-47c4-4ca1-bf47-18517842e951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:22.768893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3c96cd8e-47c4-4ca1-bf47-18517842e951 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:22.770402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c96cd8e-47c4-4ca1-bf47-18517842e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:22.845888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 458/920] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:22.868337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd915f-2e57-4d54-a36a-e7758112b894 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:22.926757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:22.981650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd915f-2e57-4d54-a36a-e7758112b894 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:22.994728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3dd80-c4db-400f-aca0-686440fce2eb None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:22.994987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3dd80-c4db-400f-aca0-686440fce2eb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:22.995236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3dd80-c4db-400f-aca0-686440fce2eb None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:22.996980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 459/921] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:23.002259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b652-9bc8-46b2-9f72-cd71e3874ead None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.002549 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b652-9bc8-46b2-9f72-cd71e3874ead None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.002835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b652-9bc8-46b2-9f72-cd71e3874ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.020768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3187b652-9bc8-46b2-9f72-cd71e3874ead None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:23.021670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.022071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3187b652-9bc8-46b2-9f72-cd71e3874ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:23.023788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.024278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.024773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.039265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:23.050092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:23.051047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:23.051895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:23.055446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 463/922] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 3 09:44:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:23.060786 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.108924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 460/923] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:23.132112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b652-9bc8-46b2-9f72-cd71e3874ead None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.176289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:23.189547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ddcd-0def-4137-831e-f28ebc07fec1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.202773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:23.236938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.238203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.238661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.239348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.240712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:23.241183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.244232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.255442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 464/924] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:23.262110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.267435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b652-9bc8-46b2-9f72-cd71e3874ead None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.312066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.313067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.313454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.313877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.314636 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.316122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:23.333219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:23.334425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 09:44:23.335855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:23.337922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 461/925] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:23.342021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.394816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80979-d349-4fbd-8bde-497070c53483 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.431262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.432208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.432569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.432924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.444439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.446533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.454403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:23.459016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca8280-b61c-48e7-a089-3e1899c7f500 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:23.466054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:23.466944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:23.467824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:23.467824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:23.467824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:23.467824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:23.471988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 465/926] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:23.473014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.499079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.500153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.500641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.501237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:23.501648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.503338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:23.503861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.505526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.511212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 462/927] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:23.516823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.599264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab853b5-1f59-49b8-badf-bd9914d13d98 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.631904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49f37-2f47-4320-94ca-0a9fd2fca6ab None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.637288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.639210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.639501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.639784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.640542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:23.640854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.642491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.656836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 466/928] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:23.662533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.671034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09927209-572f-4744-9213-05e17d7ccd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.671997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09927209-572f-4744-9213-05e17d7ccd5e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.672483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09927209-572f-4744-9213-05e17d7ccd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.672957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09927209-572f-4744-9213-05e17d7ccd5e None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.673894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09927209-572f-4744-9213-05e17d7ccd5e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:23.674402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09927209-572f-4744-9213-05e17d7ccd5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.676085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09927209-572f-4744-9213-05e17d7ccd5e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.681483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 463/929] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:23.682797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652e49-9833-4947-b3ed-a79f1e3e5741 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.683089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652e49-9833-4947-b3ed-a79f1e3e5741 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.683371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652e49-9833-4947-b3ed-a79f1e3e5741 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.684567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 464/930] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:23.690271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652e49-9833-4947-b3ed-a79f1e3e5741 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.718818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:23.756138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:23.777123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ef65e-ebef-4a0b-8965-3f075ba10320 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.802447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652e49-9833-4947-b3ed-a79f1e3e5741 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:23.812327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa36207-6c6d-49d4-8323-218108991ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.813122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa36207-6c6d-49d4-8323-218108991ced None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.813409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa36207-6c6d-49d4-8323-218108991ced None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.813682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa36207-6c6d-49d4-8323-218108991ced None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.821446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa36207-6c6d-49d4-8323-218108991ced None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.822925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa36207-6c6d-49d4-8323-218108991ced None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.837440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:23.838119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.838405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.838681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-afa36207-6c6d-49d4-8323-218108991ced None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:23.839277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:23.840202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:23.846199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:23.846773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:23.846858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 467/931] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:23.846935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:23.847015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fa5af-29f4-4490-be83-d872a9c573f9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:23.847015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fa5af-29f4-4490-be83-d872a9c573f9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:23.847015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fa5af-29f4-4490-be83-d872a9c573f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:23.862790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5f7fa5af-29f4-4490-be83-d872a9c573f9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:23.863956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5f7fa5af-29f4-4490-be83-d872a9c573f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:23.873889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 465/932] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:44:23.873889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:23.968143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 468/933] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:23.979159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:23.990609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fa5af-29f4-4490-be83-d872a9c573f9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.000061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea4f4f-dbf6-48f5-9f82-f7f5bea7c97b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.037967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.038646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.038877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.039159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.040151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:24.040338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.041840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.062127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 466/934] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:24.067481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.076985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:24.121739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fa5af-29f4-4490-be83-d872a9c573f9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.162962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.164305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.164586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.164866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.165526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.166933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:24.183280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:24.184443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:24.190725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 469/935] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:24.193304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.203506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140a0e-ac74-4b3c-b434-9f96b448d538 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.242524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.243432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.243786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.244244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.255654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:24.258503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.259896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:24.278973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:24.280004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:24.280893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:24.280893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:24.280893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:24.280893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:24.281128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 467/936] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:24.286664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.313461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845809bd-063c-402d-b0f2-8bc999094b36 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.349838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:24.355762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.356706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.357502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.358316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.359229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:24.359760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.361603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.367937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 470/937] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:24.373197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.420065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a032-3637-417b-a00c-88fc3d1815e0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.455848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.457025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.457520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.458036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.458993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:24.459523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.461679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.474248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 468/938] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:24.482705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.486343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18b03-9654-4f1d-9cc5-4e27c4273adf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.528527 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa127-dbd8-4904-b7e0-cedc536b9815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.529932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa127-dbd8-4904-b7e0-cedc536b9815 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.530370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa127-dbd8-4904-b7e0-cedc536b9815 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.531193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa127-dbd8-4904-b7e0-cedc536b9815 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.531919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa127-dbd8-4904-b7e0-cedc536b9815 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:24.532228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa127-dbd8-4904-b7e0-cedc536b9815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.533659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa127-dbd8-4904-b7e0-cedc536b9815 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.543934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 471/939] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:24.543934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0547-190f-4944-8000-4667159697ad None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.543934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0547-190f-4944-8000-4667159697ad None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.543934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0547-190f-4944-8000-4667159697ad None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.543934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 472/940] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:24.545532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:24.547472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0547-190f-4944-8000-4667159697ad None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.597406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7543-ff95-489a-b0ed-443c0c11c764 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.610785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:24.633499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433be9a-bcff-47e3-b9cd-ee31566ccf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.634323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433be9a-bcff-47e3-b9cd-ee31566ccf23 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.634612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433be9a-bcff-47e3-b9cd-ee31566ccf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.634879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433be9a-bcff-47e3-b9cd-ee31566ccf23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.641990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433be9a-bcff-47e3-b9cd-ee31566ccf23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.643229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433be9a-bcff-47e3-b9cd-ee31566ccf23 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.655958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0547-190f-4944-8000-4667159697ad None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0433be9a-bcff-47e3-b9cd-ee31566ccf23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:24.658007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:24.658923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:24.659860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 469/941] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:24.660358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55af1b-45fb-4853-94f9-2b7cf0c0c116 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.661605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55af1b-45fb-4853-94f9-2b7cf0c0c116 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.661605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55af1b-45fb-4853-94f9-2b7cf0c0c116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.677123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8b55af1b-45fb-4853-94f9-2b7cf0c0c116 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:24.678338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8b55af1b-45fb-4853-94f9-2b7cf0c0c116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:24.697995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.698658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.698942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.699219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.700009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] RBAC: Adding query filter params (interface=public, service_id=86cf24fbd25e4abb8d853ba4350568f1, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:24.700320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.701690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.707259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 473/942] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/endpoints?service_id=86cf24fbd25e4abb8d853ba4350568f1&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:24.712181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.750164 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 470/943] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:24.758859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55af1b-45fb-4853-94f9-2b7cf0c0c116 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.807387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:24.825017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a4f3-9e35-4513-b315-1a7407562631 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.856807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:24.868117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55af1b-45fb-4853-94f9-2b7cf0c0c116 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:24.869045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.869709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.870027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.870308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.871097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:24.871411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.872842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.885095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 474/944] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:24.885650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:24.914341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:24.915412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:24.915931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:24.916420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:24.917304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:24.918922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:24.925242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 471/945] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:24 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:44:24.925935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:25.023920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b364ef-14fb-451c-a41c-bc297249f3af None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:25.067940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e19a8-b609-43a6-88c8-7995f4e578c8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:25.076448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:25.077251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:25.077608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:25.078003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:25.078803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:25.079154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:25.080548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:25.082044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING keystone.server.flask.common [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 09:44:25.109371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.sql.core [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 09:44:25.109371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 09:44:25.109371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [parameters: {'id': '86df4118fe984b25875947ffa57e178e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 09:44:25.109371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 09:44:25.117466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:25.118827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:25.119345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 86df4118fe984b25875947ffa57e178e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 86df4118fe984b25875947ffa57e178e. Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 09:44:25.119795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 03 09:44:25.121490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application yield resource Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise self.value Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application session.commit() Jun 03 09:44:25.122528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.flush() Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application compat.raise_( Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 09:44:25.123438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 09:44:25.124346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 09:44:25.125168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [parameters: {'id': '86df4118fe984b25875947ffa57e178e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:25.127412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:25.128902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 86df4118fe984b25875947ffa57e178e. Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.130067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 475/946] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Jun 3 09:44:24 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:25.131261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/12d8d367b1a84e0e98a3fcdb1c979d9b/roles/ad0b575d79cd4ff19d7b15c7dec12940` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:25.133869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=12d8d367b1a84e0e98a3fcdb1c979d9b, role_id=ad0b575d79cd4ff19d7b15c7dec12940)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:25.135385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:25.135545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:25.157734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 472/947] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:44:24 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/12d8d367b1a84e0e98a3fcdb1c979d9b/roles/ad0b575d79cd4ff19d7b15c7dec12940 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:44:25.194132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:25.270087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cdc6e-563e-4f93-b6ca-b8c27a2e1ded None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:25.311364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb915674-eb1c-4c6c-8173-ab43dd4131a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:25.312183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb915674-eb1c-4c6c-8173-ab43dd4131a1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:25.312482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb915674-eb1c-4c6c-8173-ab43dd4131a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:25.312804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb915674-eb1c-4c6c-8173-ab43dd4131a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:25.321470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb915674-eb1c-4c6c-8173-ab43dd4131a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:25.323348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb915674-eb1c-4c6c-8173-ab43dd4131a1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-cb915674-eb1c-4c6c-8173-ab43dd4131a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:25.340244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:25.341197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:25.342132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 476/948] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:25.349723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:25.475166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfbb25-cb50-4e63-a993-1357866c32e9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:25.513258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c960f4-d8e8-4c52-b7f2-e36f53253db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:25.513998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c960f4-d8e8-4c52-b7f2-e36f53253db7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:25.514288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c960f4-d8e8-4c52-b7f2-e36f53253db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:25.514564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c960f4-d8e8-4c52-b7f2-e36f53253db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:25.515366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c960f4-d8e8-4c52-b7f2-e36f53253db7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:25.515670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c960f4-d8e8-4c52-b7f2-e36f53253db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:25.517151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c960f4-d8e8-4c52-b7f2-e36f53253db7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:25.539584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 473/949] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:26.367221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff870-5950-4fb8-b0fd-8f960c2cd797 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:26.367776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff870-5950-4fb8-b0fd-8f960c2cd797 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:26.367776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff870-5950-4fb8-b0fd-8f960c2cd797 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:26.372173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 477/950] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:26.378006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135d86-fb08-4113-ac7d-5a36403856ad None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:26.378468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135d86-fb08-4113-ac7d-5a36403856ad None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:26.380755 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135d86-fb08-4113-ac7d-5a36403856ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:26.398380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b5135d86-fb08-4113-ac7d-5a36403856ad None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:26.399568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5135d86-fb08-4113-ac7d-5a36403856ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:26.423154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:26.473924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 474/951] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:26.496201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff870-5950-4fb8-b0fd-8f960c2cd797 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:26.600483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:26.605061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff870-5950-4fb8-b0fd-8f960c2cd797 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:26.642176 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:26.642898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:26.643186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:26.643466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:26.644121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:26.645480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:26.657779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:26.658982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:26.659868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 478/952] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:26.665371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135d86-fb08-4113-ac7d-5a36403856ad None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:26.768900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135d86-fb08-4113-ac7d-5a36403856ad None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:26.805399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516561c-be70-46a5-ace4-81283c1318d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:26.806266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516561c-be70-46a5-ace4-81283c1318d6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:26.806619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516561c-be70-46a5-ace4-81283c1318d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:26.806965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516561c-be70-46a5-ace4-81283c1318d6 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:26.807741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516561c-be70-46a5-ace4-81283c1318d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:26.808121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516561c-be70-46a5-ace4-81283c1318d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:26.809567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516561c-be70-46a5-ace4-81283c1318d6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:26.814835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 475/953] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:26.820560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:26.926250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc753a-b8bf-4fbb-9e31-4666ed21c249 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:26.962761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee2cd2-344c-400e-9fc1-ec008e39d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:26.963430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee2cd2-344c-400e-9fc1-ec008e39d4bc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:26.963715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee2cd2-344c-400e-9fc1-ec008e39d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:26.963995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee2cd2-344c-400e-9fc1-ec008e39d4bc None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:26.964709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee2cd2-344c-400e-9fc1-ec008e39d4bc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:26.965016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee2cd2-344c-400e-9fc1-ec008e39d4bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:26.966409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee2cd2-344c-400e-9fc1-ec008e39d4bc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:26.971522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 479/954] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:27.397057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793ce0-5721-47ac-b368-19985abf313a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:27.397816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793ce0-5721-47ac-b368-19985abf313a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:27.397995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793ce0-5721-47ac-b368-19985abf313a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:27.399736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 476/955] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:27.405173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9945a-9d1d-4fb2-b49c-829cd63b02c9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:27.406053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9945a-9d1d-4fb2-b49c-829cd63b02c9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:27.406538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9945a-9d1d-4fb2-b49c-829cd63b02c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:27.423714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f1b9945a-9d1d-4fb2-b49c-829cd63b02c9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:27.425551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f1b9945a-9d1d-4fb2-b49c-829cd63b02c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:27.449810 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:27.499492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 480/956] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:27.528264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793ce0-5721-47ac-b368-19985abf313a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:27.550237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:27.601467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801842-2d86-495c-adcd-ec598dce2718 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:27.601859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801842-2d86-495c-adcd-ec598dce2718 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:27.602055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801842-2d86-495c-adcd-ec598dce2718 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:27.603730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 481/957] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:27.609374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004d6a7-0638-4688-941f-b2a9141cc39b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:27.609710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004d6a7-0638-4688-941f-b2a9141cc39b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:27.609972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004d6a7-0638-4688-941f-b2a9141cc39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:27.628887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e004d6a7-0638-4688-941f-b2a9141cc39b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:27.630128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e004d6a7-0638-4688-941f-b2a9141cc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:27.641214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793ce0-5721-47ac-b368-19985abf313a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:27.676602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:27.677405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:27.677694 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:27.678006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:27.678656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:27.680561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:27.692451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:27.693493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:27.694488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:27.699273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 477/958] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:27.700484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:27.703329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 482/959] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:27.727166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004d6a7-0638-4688-941f-b2a9141cc39b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:27.795074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:27.813340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290401-7393-4a37-bc83-39d5c2d9ef12 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:27.842206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:27.852771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:27.853826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:27.854248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:27.854653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:27.855476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:27.855942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:27.857440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:27.860560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004d6a7-0638-4688-941f-b2a9141cc39b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:27.876503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 478/960] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:27.878120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:27.900615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:27.901499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:27.901917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:27.902296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:27.913570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:27.922120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:27.923259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:27.924321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:27.926452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 483/961] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 3 09:44:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:27.931841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:27.988747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d9dfe-ba1a-4276-bf58-fb549b780d69 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.024241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88036d5-996e-4510-b231-2bb1861a5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.024899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88036d5-996e-4510-b231-2bb1861a5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.025193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88036d5-996e-4510-b231-2bb1861a5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.025470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88036d5-996e-4510-b231-2bb1861a5aa4 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.026196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88036d5-996e-4510-b231-2bb1861a5aa4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:28.026506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88036d5-996e-4510-b231-2bb1861a5aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.027896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88036d5-996e-4510-b231-2bb1861a5aa4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.033026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 479/962] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:28.034128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf19bc-2321-4c0c-a2a8-2ed831bc0ca0 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.034419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf19bc-2321-4c0c-a2a8-2ed831bc0ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.034701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf19bc-2321-4c0c-a2a8-2ed831bc0ca0 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.036046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 480/963] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:28.040622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf19bc-2321-4c0c-a2a8-2ed831bc0ca0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.055695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970e25-666c-4d8b-a5c5-7e903cd3372f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.056131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:28.093528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135912e-445e-4b79-a76a-0809836fa813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.094238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135912e-445e-4b79-a76a-0809836fa813 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.094512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135912e-445e-4b79-a76a-0809836fa813 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.094784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135912e-445e-4b79-a76a-0809836fa813 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.095517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135912e-445e-4b79-a76a-0809836fa813 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:28.095820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135912e-445e-4b79-a76a-0809836fa813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.097342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135912e-445e-4b79-a76a-0809836fa813 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.105572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 484/964] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 3 09:44:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:28.106840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2156b-a589-40fc-b376-d7f4e7656ce1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.107136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2156b-a589-40fc-b376-d7f4e7656ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.107423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2156b-a589-40fc-b376-d7f4e7656ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.123881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cbf2156b-a589-40fc-b376-d7f4e7656ce1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:28.125049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cbf2156b-a589-40fc-b376-d7f4e7656ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:28.127822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:28.156755 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf19bc-2321-4c0c-a2a8-2ed831bc0ca0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.193572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.194282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.194625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.194907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.195656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.197062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.204288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 485/965] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:28.205138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2156b-a589-40fc-b376-d7f4e7656ce1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.230300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 481/966] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:28.236216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.330852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2156b-a589-40fc-b376-d7f4e7656ce1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.350244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:28.369898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65505ec5-f5b9-449d-9052-31b357704cbc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.370995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.371972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.372406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.372828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.392436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:28.395031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.396751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.413110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.414580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.415044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.415546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.416440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.418126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:28.418449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:28.419602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:28.420497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:28.420497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:28.420497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:28.420497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:28.420497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 486/967] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:28.422587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING keystone.server.flask.common [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 09:44:28.426653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.443806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.sql.core [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 09:44:28.443806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 09:44:28.443806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [parameters: {'user_id': '79363af9af8c4915a6c6757d48f8f97c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 09:44:28.443806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80149) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() Jun 03 09:44:28.461368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 09:44:28.462385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application yield resource Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise self.value Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application session.commit() Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 09:44:28.463389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.flush() Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application compat.raise_( Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 09:44:28.464420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 09:44:28.465357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 09:44:28.466262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [parameters: {'user_id': '79363af9af8c4915a6c6757d48f8f97c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:28.467104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 03 09:44:28.467908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 482/968] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Jun 3 09:44:28 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:28.468824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.552081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86455a-b739-431f-8971-9019c7c76716 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.589780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.590461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.590749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.591063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.591744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:28.592053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.593424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.593980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4017eb1-6b32-40f1-8c22-0b3948aff287 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.610926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 487/969] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:28.611960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.633424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:28.645572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.646691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.646987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.647267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.659586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.662337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:28.681790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:28.682779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:28.683740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 483/970] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:28.688472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.690682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:28.754261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40c6b-80ce-4352-85ba-192d9ce2a86d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.796440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41417333-1674-4616-9529-0e38c88c5398 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.797025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.798128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.798637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.799115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.807915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.810278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:28.831466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:28.832586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 09:44:28.833569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:28.834178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:28.834178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:28.834178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:28.834178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:28.834444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:28.834444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:28.836140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:28.842297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 488/971] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:44:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:28.846782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:28.888991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 484/972] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Jun 3 09:44:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:28.965714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ba7ed-8453-4e25-b223-fb7f1d9e2fca None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:28.981093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:29.005592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8dbaa-bb0c-4599-9d07-a99a3636623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:29.006342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dbaa-bb0c-4599-9d07-a99a3636623d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.006674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dbaa-bb0c-4599-9d07-a99a3636623d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.006990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dbaa-bb0c-4599-9d07-a99a3636623d None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.007915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8dbaa-bb0c-4599-9d07-a99a3636623d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:29.008232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8dbaa-bb0c-4599-9d07-a99a3636623d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:29.009788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8dbaa-bb0c-4599-9d07-a99a3636623d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:29.032418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 489/973] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Jun 3 09:44:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:29.038505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:29.094672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:29.153249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d0e6-4f97-4e53-85f7-29c120ecfcce None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:29.188831 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:29.189494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.189846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.190139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.265979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:29.267381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:29.313461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:29.361509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6068-0a20-4ca4-85b0-95481822aaad None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.362072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6068-0a20-4ca4-85b0-95481822aaad None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.362591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6068-0a20-4ca4-85b0-95481822aaad None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.365908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 490/974] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:29.370803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10468314-b366-4221-b7fa-adf7e0f525d3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.371098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10468314-b366-4221-b7fa-adf7e0f525d3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.371386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10468314-b366-4221-b7fa-adf7e0f525d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.374140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 485/975] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:29.381428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:29.394578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-10468314-b366-4221-b7fa-adf7e0f525d3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:29.395799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-10468314-b366-4221-b7fa-adf7e0f525d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:29.471985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 491/976] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:29.494906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10468314-b366-4221-b7fa-adf7e0f525d3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:29.496017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a94be1-ed20-49c1-b3c5-a5931cef12b7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:29.532763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:29.533471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.533780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.534051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.544581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:29.546070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:29.548830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:29.565256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:29.566268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:29.567240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:29.567240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:29.567240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:29.567240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:29.567240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 486/977] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:29.572574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:29.604198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:29.609109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10468314-b366-4221-b7fa-adf7e0f525d3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:29.644585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:29.645618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.645618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.645820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.646536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:29.648684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:29.663070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 492/978] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:29 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:44:29.679699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9c53-87f3-458e-9df0-9151f4401b1a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:29.729044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:29.730184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.730717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.731210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.732189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:29.732686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:29.734818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:29.748937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 487/979] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:29.754591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:29.867811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b6353-25fa-4eab-aaff-142ee7f86d73 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:29.903271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:29.904444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:29.904956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:29.905448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:29.912836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:29.915077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:29.929415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:29.930403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:29.931325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:29.933827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 493/980] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:29.937340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:29.994209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:30.043077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72248fc-9ebc-4068-b78b-5d33092872e5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:30.076748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ddf4f-b9b3-48d6-b87a-ee2fe7fb8959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:30.077415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ddf4f-b9b3-48d6-b87a-ee2fe7fb8959 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:30.077773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ddf4f-b9b3-48d6-b87a-ee2fe7fb8959 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:30.078052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ddf4f-b9b3-48d6-b87a-ee2fe7fb8959 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:30.078829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ddf4f-b9b3-48d6-b87a-ee2fe7fb8959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:30.079143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ddf4f-b9b3-48d6-b87a-ee2fe7fb8959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:30.080579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ddf4f-b9b3-48d6-b87a-ee2fe7fb8959 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:30.092938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 488/981] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:30.098629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:30.121369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:30.206169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78e32-1a02-4821-87e8-06d445d52e56 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:30.243135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c2e9c-294b-4082-9023-2598151bd21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:30.243811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c2e9c-294b-4082-9023-2598151bd21a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:30.244101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c2e9c-294b-4082-9023-2598151bd21a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:30.244378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c2e9c-294b-4082-9023-2598151bd21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:30.245233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c2e9c-294b-4082-9023-2598151bd21a None admin] RBAC: Adding query filter params (role.id=ad0b575d79cd4ff19d7b15c7dec12940, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=12d8d367b1a84e0e98a3fcdb1c979d9b) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:30.245548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c2e9c-294b-4082-9023-2598151bd21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:30.247229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c2e9c-294b-4082-9023-2598151bd21a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:30.261819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 494/982] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:30 2022] GET /identity/v3/role_assignments?user.id=12d8d367b1a84e0e98a3fcdb1c979d9b&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=ad0b575d79cd4ff19d7b15c7dec12940 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:30.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08bbcc-2db8-4bf3-916b-f62e8c119173 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:30.572962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08bbcc-2db8-4bf3-916b-f62e8c119173 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:30.573061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08bbcc-2db8-4bf3-916b-f62e8c119173 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:30.574570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 489/983] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:30.579625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37b54-fcd1-456a-a797-47fa3bc50176 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:30.580010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37b54-fcd1-456a-a797-47fa3bc50176 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:30.580178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37b54-fcd1-456a-a797-47fa3bc50176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:30.603156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dac37b54-fcd1-456a-a797-47fa3bc50176 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:30.604339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dac37b54-fcd1-456a-a797-47fa3bc50176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:30.673343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 495/984] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:30.696053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08bbcc-2db8-4bf3-916b-f62e8c119173 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:30.799278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08bbcc-2db8-4bf3-916b-f62e8c119173 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:30.813853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:30.837116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:30.837970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:30.838259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:30.838540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:30.839185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:30.840564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:30.853457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:30.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:30.860453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 490/985] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:30.861281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37b54-fcd1-456a-a797-47fa3bc50176 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:30.877855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:30.963572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37b54-fcd1-456a-a797-47fa3bc50176 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:30.998757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:30.999413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:30.999697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:30.999974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:31.000671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:31.000978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:31.002384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:31.007839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 496/986] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:31.013303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:31.114483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e7312-01c4-4f4d-a1f5-d16924ad2526 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:31.148908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:31.149573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:31.149891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:31.150169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:31.150868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:31.151174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:31.152541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:31.157612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 491/987] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:31.163342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:31.241246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:31.265735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3513-4730-4011-99b9-6d27e88f93f0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:31.301028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476ee45-408c-4e1c-a6eb-2b08f81e8b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:31.301682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476ee45-408c-4e1c-a6eb-2b08f81e8b13 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:31.301996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476ee45-408c-4e1c-a6eb-2b08f81e8b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:31.302278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476ee45-408c-4e1c-a6eb-2b08f81e8b13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:31.303068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476ee45-408c-4e1c-a6eb-2b08f81e8b13 None admin] RBAC: Adding query filter params (interface=admin, service_id=86cf24fbd25e4abb8d853ba4350568f1, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:31.303383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476ee45-408c-4e1c-a6eb-2b08f81e8b13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:31.305283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476ee45-408c-4e1c-a6eb-2b08f81e8b13 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:31.310613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 497/988] 10.222.0.45 () {56 vars in 1249 bytes} [Fri Jun 3 09:44:31 2022] GET /identity/v3/endpoints?service_id=86cf24fbd25e4abb8d853ba4350568f1&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:31.315933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:31.362228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:31.432893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbed3d1-e225-4330-88e1-92dd71048c0a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:31.467338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcf3a3-9f42-4f6e-8f54-fc74d46f4519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:31.468151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf3a3-9f42-4f6e-8f54-fc74d46f4519 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:31.468538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf3a3-9f42-4f6e-8f54-fc74d46f4519 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:31.468916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf3a3-9f42-4f6e-8f54-fc74d46f4519 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:31.469695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcf3a3-9f42-4f6e-8f54-fc74d46f4519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:31.471199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcf3a3-9f42-4f6e-8f54-fc74d46f4519 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:31.481972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 492/989] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:31 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:44:31.944353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8e7c-d777-4a95-9a6e-4ecf2012a3e8 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:31.944882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8e7c-d777-4a95-9a6e-4ecf2012a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:31.945002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8e7c-d777-4a95-9a6e-4ecf2012a3e8 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:31.946499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 498/990] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:31.951629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b3e98-d9ae-4479-9d8b-d1c1214f517f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:31.952034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b3e98-d9ae-4479-9d8b-d1c1214f517f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:31.952198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b3e98-d9ae-4479-9d8b-d1c1214f517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:31.969525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4b1b3e98-d9ae-4479-9d8b-d1c1214f517f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:31.971119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b1b3e98-d9ae-4479-9d8b-d1c1214f517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:32.041107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 493/991] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:32.064051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea8e7c-d777-4a95-9a6e-4ecf2012a3e8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:32.167519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea8e7c-d777-4a95-9a6e-4ecf2012a3e8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:32.202535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:32.203248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.203538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.203824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.204487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:32.206023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:32.218541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:32.219606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:32.220470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 499/992] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:32.228373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b3e98-d9ae-4479-9d8b-d1c1214f517f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:32.268413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:32.337513 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b3e98-d9ae-4479-9d8b-d1c1214f517f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:32.372082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:32.372748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.373037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.373318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.374044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:32.374356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:32.378512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:32.384871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 494/993] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:32.390443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:32.400267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:32.493777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d251c6-4c5b-4729-803c-7e3c2a31e15d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:32.527432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc560415-85b4-43ec-ac63-965cb289252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:32.528106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560415-85b4-43ec-ac63-965cb289252b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.528450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560415-85b4-43ec-ac63-965cb289252b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.528701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560415-85b4-43ec-ac63-965cb289252b None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.529408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc560415-85b4-43ec-ac63-965cb289252b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:32.529716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc560415-85b4-43ec-ac63-965cb289252b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:32.531116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc560415-85b4-43ec-ac63-965cb289252b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:32.542861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 500/994] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:32.543048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:32.565672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871153-752c-4e9c-b823-24616a5f4d0f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.566020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871153-752c-4e9c-b823-24616a5f4d0f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.566294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871153-752c-4e9c-b823-24616a5f4d0f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.567819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 501/995] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:32.572856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589e7ca-8170-4bd6-a3c3-fd4f32b13400 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.572983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589e7ca-8170-4bd6-a3c3-fd4f32b13400 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.573194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589e7ca-8170-4bd6-a3c3-fd4f32b13400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.593349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9589e7ca-8170-4bd6-a3c3-fd4f32b13400 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:32.594593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9589e7ca-8170-4bd6-a3c3-fd4f32b13400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:32.655239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:32.659398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae09341-415b-4339-a218-b8df5ee284f4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:32.668148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:32.673926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 502/996] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:32.695772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589e7ca-8170-4bd6-a3c3-fd4f32b13400 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:32.697628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:32.698328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.698672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.698957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.699774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] RBAC: Adding query filter params (interface=public, service_id=702765b3e6b84d7b9c003b9d53965cd7, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:32.700085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:32.701454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:32.711951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 495/997] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:44:32 2022] GET /identity/v3/endpoints?service_id=702765b3e6b84d7b9c003b9d53965cd7&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:32.717655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:32.807367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589e7ca-8170-4bd6-a3c3-fd4f32b13400 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:32.820460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e99bc-b188-4e79-859b-0116c7355b4a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:32.843472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:32.844281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.844605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.844922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] PATH_INFO: `/v3/services/image` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.845719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:32.847353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:32.854150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:32.854819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:32.855108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:32.855391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:32.856077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:32.857445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:32.860488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:32.861519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:32.862819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 503/998] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Jun 3 09:44:32 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:32.878128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 496/999] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:32 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:44:32.878338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:32.946926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:32.990826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea814e-8f73-49f0-b9ea-a5c785076c75 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:33.027622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ce954-b770-4746-a9b1-020bcc1b68ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:33.028306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce954-b770-4746-a9b1-020bcc1b68ce None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:33.028597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce954-b770-4746-a9b1-020bcc1b68ce None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:33.028882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce954-b770-4746-a9b1-020bcc1b68ce None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:33.029601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce954-b770-4746-a9b1-020bcc1b68ce None admin] RBAC: Adding query filter params (name=image) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:33.029947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce954-b770-4746-a9b1-020bcc1b68ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:33.031367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce954-b770-4746-a9b1-020bcc1b68ce None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:33.041443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 504/1000] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:33.043126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:33.074686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:33.149370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93937304-8b2e-4988-9e35-ccd9e0d12efc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:33.182565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e1955-54e2-4715-8b14-b6cc16a1fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:33.183224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e1955-54e2-4715-8b14-b6cc16a1fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:33.183509 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e1955-54e2-4715-8b14-b6cc16a1fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:33.183785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e1955-54e2-4715-8b14-b6cc16a1fac9 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:33.184476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e1955-54e2-4715-8b14-b6cc16a1fac9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:33.184782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e1955-54e2-4715-8b14-b6cc16a1fac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:33.186194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e1955-54e2-4715-8b14-b6cc16a1fac9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:33.190935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 497/1001] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:33.760314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33a65c-8f96-40ff-8cc0-a494c39a531b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:33.760608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33a65c-8f96-40ff-8cc0-a494c39a531b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:33.760891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33a65c-8f96-40ff-8cc0-a494c39a531b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:33.762475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 505/1002] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:33.767407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddba1a0-ff72-40ba-ac42-13e1f5ebb9c7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:33.767704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddba1a0-ff72-40ba-ac42-13e1f5ebb9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:33.767991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddba1a0-ff72-40ba-ac42-13e1f5ebb9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:33.785136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cddba1a0-ff72-40ba-ac42-13e1f5ebb9c7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:33.786330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cddba1a0-ff72-40ba-ac42-13e1f5ebb9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:33.853800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 498/1003] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:33.877001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33a65c-8f96-40ff-8cc0-a494c39a531b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:33.980887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33a65c-8f96-40ff-8cc0-a494c39a531b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:34.006660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:34.017881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:34.018627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:34.018914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:34.019193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:34.019859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:34.021252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:34.034669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:34.035673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 09:44:34.036523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:34.044139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 506/1004] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Jun 3 09:44:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:34.044270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddba1a0-ff72-40ba-ac42-13e1f5ebb9c7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:34.064644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:34.143403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddba1a0-ff72-40ba-ac42-13e1f5ebb9c7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:34.176907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:34.177579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:34.177895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:34.178176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:34.179406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:34.179717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:34.181089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:34.186145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 499/1005] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:34.191562 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:34.300609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b524f1-f807-49de-a417-dd8eb16fff01 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:34.336370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47946a7e-fabd-44f8-aa0b-e30887a50d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:34.337033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47946a7e-fabd-44f8-aa0b-e30887a50d5c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:34.337319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47946a7e-fabd-44f8-aa0b-e30887a50d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:34.337598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47946a7e-fabd-44f8-aa0b-e30887a50d5c None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:34.338334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47946a7e-fabd-44f8-aa0b-e30887a50d5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:34.338642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47946a7e-fabd-44f8-aa0b-e30887a50d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:34.340009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47946a7e-fabd-44f8-aa0b-e30887a50d5c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:34.344813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 507/1006] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Jun 3 09:44:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:34.350554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:34.443119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:34.460899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74609c9-7a0a-4026-a643-0fc31ad31353 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:34.496015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc90016-24ac-4dd0-984d-c33bb65965ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:34.496676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc90016-24ac-4dd0-984d-c33bb65965ef None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:34.496964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc90016-24ac-4dd0-984d-c33bb65965ef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:34.497243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc90016-24ac-4dd0-984d-c33bb65965ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:34.498003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc90016-24ac-4dd0-984d-c33bb65965ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:34.499375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc90016-24ac-4dd0-984d-c33bb65965ef None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:34.514362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 500/1007] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:35.168681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bcfb0-3468-4e40-83e5-ef30ce7c5af5 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.169234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bcfb0-3468-4e40-83e5-ef30ce7c5af5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.169234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bcfb0-3468-4e40-83e5-ef30ce7c5af5 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.170815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 508/1008] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:35.180227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f81e-a2ed-4059-acdf-2fbf4ee43acd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.180227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f81e-a2ed-4059-acdf-2fbf4ee43acd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.180227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f81e-a2ed-4059-acdf-2fbf4ee43acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.197684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7445f81e-a2ed-4059-acdf-2fbf4ee43acd None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:35.199245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7445f81e-a2ed-4059-acdf-2fbf4ee43acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:35.285912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 501/1009] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:35.304630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bcfb0-3468-4e40-83e5-ef30ce7c5af5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:35.368153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:35.421825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bcfb0-3468-4e40-83e5-ef30ce7c5af5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:35.465672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:35.467155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.467669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.468170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.468622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c214a7-9cf3-4ebd-bb47-efca62024551 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.468939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c214a7-9cf3-4ebd-bb47-efca62024551 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.469209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c214a7-9cf3-4ebd-bb47-efca62024551 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.469877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:35.471635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:35.474443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 502/1010] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:35.475587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3baea-1046-4a20-b74a-f1536099148c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.475912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3baea-1046-4a20-b74a-f1536099148c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.476201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3baea-1046-4a20-b74a-f1536099148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:35.487872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:35.488941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 09:44:35.489865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:35.493818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 509/1011] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:35.496895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:35.499764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ead3baea-1046-4a20-b74a-f1536099148c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:35.501507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ead3baea-1046-4a20-b74a-f1536099148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:35.570080 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:35.585770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 503/1012] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:35.598500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3baea-1046-4a20-b74a-f1536099148c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:35.606652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8034-c571-4276-865b-b39f0fa1d995 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:35.626608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:35.643877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:35.644550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.644993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.645282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.646387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] RBAC: Adding query filter params (name=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:35.646977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:35.649138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:35.659800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 510/1013] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:35.661420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:35.700493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3baea-1046-4a20-b74a-f1536099148c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:35.736427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:35.738313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.738619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.738905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.739639 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:35.741046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:35.758787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 504/1014] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:35 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:44:35.774411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f5c24-6b06-450e-9c82-e2ddde2812ad None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:35.819596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90a2a1-3e74-4766-aebe-36ff5f662c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:35.820286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a2a1-3e74-4766-aebe-36ff5f662c7d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.820569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a2a1-3e74-4766-aebe-36ff5f662c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.820843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a2a1-3e74-4766-aebe-36ff5f662c7d None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.821561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90a2a1-3e74-4766-aebe-36ff5f662c7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:35.822035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90a2a1-3e74-4766-aebe-36ff5f662c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:35.823485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90a2a1-3e74-4766-aebe-36ff5f662c7d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:35.829596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 511/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Jun 3 09:44:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:35.836095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:35.900415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:35.947372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a862e4-7880-4ecf-a74e-423eaf2aa8bb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:35.984764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610676b-2d3d-4ef0-9698-bd0634a8aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:35.985337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610676b-2d3d-4ef0-9698-bd0634a8aefd None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:35.985624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610676b-2d3d-4ef0-9698-bd0634a8aefd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:35.985936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610676b-2d3d-4ef0-9698-bd0634a8aefd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:35.986689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610676b-2d3d-4ef0-9698-bd0634a8aefd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:35.988117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610676b-2d3d-4ef0-9698-bd0634a8aefd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:36.010328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 505/1016] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:36.816782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec6a75-4957-4abb-a1ec-a81573548647 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:36.817299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec6a75-4957-4abb-a1ec-a81573548647 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:36.817481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec6a75-4957-4abb-a1ec-a81573548647 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:36.818808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 512/1017] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:36.824728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cec64-222e-460d-af3b-250f4bb3b2eb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:36.825134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cec64-222e-460d-af3b-250f4bb3b2eb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:36.825301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cec64-222e-460d-af3b-250f4bb3b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:36.842155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-677cec64-222e-460d-af3b-250f4bb3b2eb None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:36.843335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-677cec64-222e-460d-af3b-250f4bb3b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:36.920773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 506/1018] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:36.943867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec6a75-4957-4abb-a1ec-a81573548647 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:36.992898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:37.049443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec6a75-4957-4abb-a1ec-a81573548647 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:37.082770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f715a-43e1-4012-810e-25bbb787a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:37.083485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f715a-43e1-4012-810e-25bbb787a535 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:37.083774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f715a-43e1-4012-810e-25bbb787a535 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:37.084057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f715a-43e1-4012-810e-25bbb787a535 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:37.085775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f715a-43e1-4012-810e-25bbb787a535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:37.087210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f715a-43e1-4012-810e-25bbb787a535 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:37.088979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 513/1019] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:37.094604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cec64-222e-460d-af3b-250f4bb3b2eb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:37.136345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:37.195167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cec64-222e-460d-af3b-250f4bb3b2eb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:37.230769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff607770-0013-4fe4-b03a-0285c00227ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:37.231441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607770-0013-4fe4-b03a-0285c00227ab None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:37.231730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607770-0013-4fe4-b03a-0285c00227ab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:37.232015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607770-0013-4fe4-b03a-0285c00227ab None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:37.232739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff607770-0013-4fe4-b03a-0285c00227ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:37.234212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff607770-0013-4fe4-b03a-0285c00227ab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:37.265793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 507/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:44:37 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:38.032522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2781d-1ced-4041-931c-3cfbb35df71f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.033095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2781d-1ced-4041-931c-3cfbb35df71f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.033095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2781d-1ced-4041-931c-3cfbb35df71f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.034543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 514/1021] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:38.041302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667eb2-ad2d-4de7-ae60-52068a8b9ba2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.042044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667eb2-ad2d-4de7-ae60-52068a8b9ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.042044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667eb2-ad2d-4de7-ae60-52068a8b9ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.059646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4a667eb2-ad2d-4de7-ae60-52068a8b9ba2 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:38.060879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4a667eb2-ad2d-4de7-ae60-52068a8b9ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:38.130759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 508/1022] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:38.153485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2781d-1ced-4041-931c-3cfbb35df71f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.255533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2781d-1ced-4041-931c-3cfbb35df71f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.268607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:38.291618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c620403-1116-4c64-909e-4010eb033051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.292589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620403-1116-4c64-909e-4010eb033051 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.293024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620403-1116-4c64-909e-4010eb033051 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.293459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620403-1116-4c64-909e-4010eb033051 None admin] PATH_INFO: `/v3/services/image` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.294278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c620403-1116-4c64-909e-4010eb033051 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:38.295797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c620403-1116-4c64-909e-4010eb033051 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8c620403-1116-4c64-909e-4010eb033051 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:38.307508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:38.308702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:38.309764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:38.312215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 515/1023] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:38.317964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667eb2-ad2d-4de7-ae60-52068a8b9ba2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.342845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:38.371046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181c9e3-a30b-46c6-85ab-15613df8a46a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.371330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181c9e3-a30b-46c6-85ab-15613df8a46a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.371614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181c9e3-a30b-46c6-85ab-15613df8a46a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.373195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 516/1024] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:38.377968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878ae1-5669-43d6-8bd7-055dadb9bf19 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.378261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878ae1-5669-43d6-8bd7-055dadb9bf19 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.378543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878ae1-5669-43d6-8bd7-055dadb9bf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.395902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-95878ae1-5669-43d6-8bd7-055dadb9bf19 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:38.397078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-95878ae1-5669-43d6-8bd7-055dadb9bf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:38.440007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667eb2-ad2d-4de7-ae60-52068a8b9ba2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.472443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 517/1025] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:38.478640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.479308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.479592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.479865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.480569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] RBAC: Adding query filter params (name=image) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:38.480874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:38.482279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:38.492001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 509/1026] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:38.492998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878ae1-5669-43d6-8bd7-055dadb9bf19 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.498207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.598753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:38.599432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878ae1-5669-43d6-8bd7-055dadb9bf19 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.608372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:38.614035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d415-30a2-41ce-81e1-0542cd45512b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.636932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.637589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.637934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.638215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.638971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] RBAC: Adding query filter params (type=image) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:38.639278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:38.640624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:38.645530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 518/1027] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:38.651140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.651810 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.651982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.652236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.652517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.665630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:38.673810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:38.674765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:38.675626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 510/1028] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:38.681280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.755997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd59c1-cccd-4b19-9b4b-234950cfc313 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.786405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188802-815d-40b4-8178-5c888d26ae0a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.791237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.791885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.792168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.792445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.793222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] RBAC: Adding query filter params (interface=public, service_id=ed8e583f00644585b8a3b01048a8be04, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:38.793532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:38.794933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:38.800003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 519/1029] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/endpoints?service_id=ed8e583f00644585b8a3b01048a8be04&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:38.805296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.823125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.823795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.824087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.824371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.825118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:38.825553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:38.826963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:38.840954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 511/1030] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:38.841105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:38.841946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:38.854837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:38.916103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647736a-f2a4-48a3-8124-6e3a5ec327e2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.947393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949b5dd-3cd9-44a4-b77b-62e1b99e0a96 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:38.955219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.956057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.956528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.956952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:38.957807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:38.959312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:38.967009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 520/1031] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:44:38.991928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:38.992749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:38.993041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:38.993320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.005715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:39.007814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:39.027117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:39.028093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:39.034089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:39.034089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:39.034089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:39.034089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:39.034089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 512/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:39.035926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:39.143968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:39.150199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee429-8ef7-4603-bbe0-7db06586d7d5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:39.189937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:39.190613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:39.190902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:39.191184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.191913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:39.192227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:39.193600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:39.205347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 521/1033] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:39.210776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:39.279190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:39.319336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340f30-37e9-4fd8-bcf5-24e4084beef4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:39.353216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:39.354044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:39.354334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:39.354612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.362181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:39.363635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:39.378480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:39.379468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:39.380422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:39.384339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 513/1034] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:44:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:39.385871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:39.500697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade5cf6-0347-405d-a834-87a8becdcec3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:39.535840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dc1fe-ae06-45e8-bccc-d6dbaf34af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:39.536524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dc1fe-ae06-45e8-bccc-d6dbaf34af6b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:39.536814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dc1fe-ae06-45e8-bccc-d6dbaf34af6b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:39.537099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dc1fe-ae06-45e8-bccc-d6dbaf34af6b None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.537970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dc1fe-ae06-45e8-bccc-d6dbaf34af6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:39.538286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dc1fe-ae06-45e8-bccc-d6dbaf34af6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:39.539800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dc1fe-ae06-45e8-bccc-d6dbaf34af6b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:39.559130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 522/1035] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:44:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:39.563943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:39.586688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abc740-f76f-49fc-99c4-2a61104fc4d8 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:39.590556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abc740-f76f-49fc-99c4-2a61104fc4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:39.590556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abc740-f76f-49fc-99c4-2a61104fc4d8 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.590556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 523/1036] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:39.597595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696fca4-b598-451f-a8d7-787b66f35667 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:39.597941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696fca4-b598-451f-a8d7-787b66f35667 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:39.598489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696fca4-b598-451f-a8d7-787b66f35667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.619799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1696fca4-b598-451f-a8d7-787b66f35667 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:39.621006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1696fca4-b598-451f-a8d7-787b66f35667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:39.635641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:39.682723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6be3cb-43c5-4e14-a6bb-b43299536013 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:39.695584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 524/1037] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:39.707241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:39.719771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:39.720100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696fca4-b598-451f-a8d7-787b66f35667 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:39.720428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:39.720715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:39.720993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.795440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:39.796834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:39.825365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696fca4-b598-451f-a8d7-787b66f35667 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:39.860877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:39.861662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:39.861990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:39.862274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:39.863457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:39.864896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:39.866819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 525/1038] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:39.872331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:39.887581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:39.905343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 514/1039] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:39.910599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:39.935658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:39.983413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a24d98-26f4-4c63-bdeb-635cd015b697 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:40.012143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f5b7-7223-47ad-be90-92e2cda4a06b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:40.023422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:40.024086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:40.024374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:40.024654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:40.025363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:40.026819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:40.048395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 526/1040] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:44:39 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:44:40.057332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:40.058428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:40.058881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:40.059272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:40.071715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:40.073256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:40.092432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:40.093421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:40.094653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:40.094653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:40.094653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:40.094653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:40.094653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 515/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:40.099819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:40.178156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:40.214272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac65c-d09e-40fd-9408-61fea98286fc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:40.250035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:40.250702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:40.250984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:40.251261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:40.252681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:40.252681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:40.253645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:40.267961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 527/1042] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:40.274505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:40.352413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:40.378211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae8dbc-6fb6-412c-ad93-df962efb6930 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:40.415166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:40.415958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:40.416245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:40.416523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:40.423241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:40.424682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:40.438672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:40.439581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:40.440597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:40.441839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 516/1043] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:40.446499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:40.546743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48e50c-457c-4c13-aede-24b5038798f8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:40.575161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:40.582190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eca2f-7b8c-455c-ae84-d0fb875bde51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:40.582854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eca2f-7b8c-455c-ae84-d0fb875bde51 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:40.583138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eca2f-7b8c-455c-ae84-d0fb875bde51 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:40.583415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eca2f-7b8c-455c-ae84-d0fb875bde51 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:40.584200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eca2f-7b8c-455c-ae84-d0fb875bde51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:40.584513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eca2f-7b8c-455c-ae84-d0fb875bde51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:40.586534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eca2f-7b8c-455c-ae84-d0fb875bde51 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:40.598379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 528/1044] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:40.604393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:40.715372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773b374-2db3-4438-aa15-3bc392b05f5e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:40.748602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686200a4-60d6-452b-b2b8-90fae4b1e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:40.749265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686200a4-60d6-452b-b2b8-90fae4b1e681 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:40.749568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686200a4-60d6-452b-b2b8-90fae4b1e681 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:40.749865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686200a4-60d6-452b-b2b8-90fae4b1e681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:40.750747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686200a4-60d6-452b-b2b8-90fae4b1e681 None admin] RBAC: Adding query filter params (role.id=ad0b575d79cd4ff19d7b15c7dec12940, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=d89ce6057b2843f2bfbc5a143eb9300e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:40.751073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686200a4-60d6-452b-b2b8-90fae4b1e681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:40.752505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686200a4-60d6-452b-b2b8-90fae4b1e681 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:40.754367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:40.765783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 517/1045] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:40 2022] GET /identity/v3/role_assignments?user.id=d89ce6057b2843f2bfbc5a143eb9300e&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=ad0b575d79cd4ff19d7b15c7dec12940 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:41.251630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b901624-df49-4ca4-86b6-58cf8884512c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:41.252160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b901624-df49-4ca4-86b6-58cf8884512c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:41.252240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b901624-df49-4ca4-86b6-58cf8884512c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:41.253795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 529/1046] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:41.259452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be64b25-dbeb-4fe3-86b8-eb008e817eea None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:41.259747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be64b25-dbeb-4fe3-86b8-eb008e817eea None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:41.260167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be64b25-dbeb-4fe3-86b8-eb008e817eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:41.277928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4be64b25-dbeb-4fe3-86b8-eb008e817eea None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:41.279225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4be64b25-dbeb-4fe3-86b8-eb008e817eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:41.347914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 518/1047] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:41.371374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b901624-df49-4ca4-86b6-58cf8884512c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:41.489399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b901624-df49-4ca4-86b6-58cf8884512c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:41.527718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:41.528506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:41.528793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:41.529072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] PATH_INFO: `/v3/services/image` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:41.529721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:41.531115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:41.543052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:41.544063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 09:44:41.544945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:41.549342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 530/1048] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Jun 3 09:44:41 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:41.550730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be64b25-dbeb-4fe3-86b8-eb008e817eea None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:41.650809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be64b25-dbeb-4fe3-86b8-eb008e817eea None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:41.677026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:41.686835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:41.687500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:41.687785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:41.688062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:41.688762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] RBAC: Adding query filter params (name=image) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:41.689075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:41.690481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:41.700404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 519/1049] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:41.701442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:41.756135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:41.803378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724e83-dff1-4039-ae14-870bcef2881d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:41.837330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaec7f8-7cb4-4dbf-8c4d-f923557367ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:41.838014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec7f8-7cb4-4dbf-8c4d-f923557367ea None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:41.838303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec7f8-7cb4-4dbf-8c4d-f923557367ea None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:41.838581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec7f8-7cb4-4dbf-8c4d-f923557367ea None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:41.839280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec7f8-7cb4-4dbf-8c4d-f923557367ea None admin] RBAC: Adding query filter params (type=image) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:41.839590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec7f8-7cb4-4dbf-8c4d-f923557367ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:41.840950 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec7f8-7cb4-4dbf-8c4d-f923557367ea None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:41.846035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 531/1050] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:41.852217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:41.953834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865457d8-f00c-43e2-9e6e-bb2edb972928 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:41.988529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0073f5b-bf3c-4bf1-b3c2-6695fcd446ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:41.989185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073f5b-bf3c-4bf1-b3c2-6695fcd446ff None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:41.989468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073f5b-bf3c-4bf1-b3c2-6695fcd446ff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:41.989742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073f5b-bf3c-4bf1-b3c2-6695fcd446ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:41.990511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0073f5b-bf3c-4bf1-b3c2-6695fcd446ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:41.992463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0073f5b-bf3c-4bf1-b3c2-6695fcd446ff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:42.012174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 520/1051] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:44:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:44:42.409723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7907e-74bf-47bd-9209-c8c8ad0d8431 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:42.410254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7907e-74bf-47bd-9209-c8c8ad0d8431 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:42.410333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7907e-74bf-47bd-9209-c8c8ad0d8431 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:42.411860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 532/1052] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:42.416955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827515ca-76fb-44c6-9312-d76e50fc977c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:42.417344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827515ca-76fb-44c6-9312-d76e50fc977c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:42.417526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827515ca-76fb-44c6-9312-d76e50fc977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:42.434593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-827515ca-76fb-44c6-9312-d76e50fc977c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:42.435788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-827515ca-76fb-44c6-9312-d76e50fc977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:42.480793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:42.513354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 521/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:42.536787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7907e-74bf-47bd-9209-c8c8ad0d8431 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:42.639998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7907e-74bf-47bd-9209-c8c8ad0d8431 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:42.657497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:42.674965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:42.675776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:42.676058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:42.676334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:42.689371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:42.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:42.698391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:42.699243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 533/1054] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:42.704763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827515ca-76fb-44c6-9312-d76e50fc977c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:42.808067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827515ca-76fb-44c6-9312-d76e50fc977c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:42.841347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:42.842054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:42.842347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:42.842628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:42.843376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:42.843688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:42.845106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:42.858746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 522/1055] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:42.860357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:42.960398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f59d-cd5c-443a-809a-ef4781fa68b7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:42.994119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbfcc-46e1-4159-9cd9-fac588e031a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:42.994976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbfcc-46e1-4159-9cd9-fac588e031a6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:42.995263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbfcc-46e1-4159-9cd9-fac588e031a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:42.995538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbfcc-46e1-4159-9cd9-fac588e031a6 None admin] PATH_INFO: `/v3/users/1ed4831521774e23b9ebff97b6e8f8ca` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.010188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbfcc-46e1-4159-9cd9-fac588e031a6 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed4831521774e23b9ebff97b6e8f8ca)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:43.011623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbfcc-46e1-4159-9cd9-fac588e031a6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:43.013478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 534/1056] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:44:42 2022] GET /identity/v3/users/1ed4831521774e23b9ebff97b6e8f8ca => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:43.019138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.032003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc7f14-acf0-478f-aab2-a069f9465f6e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.032430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc7f14-acf0-478f-aab2-a069f9465f6e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.032707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc7f14-acf0-478f-aab2-a069f9465f6e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.034116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 535/1057] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:43.040218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b649-edb3-41d1-8d1b-23af0f192ac8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.040502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b649-edb3-41d1-8d1b-23af0f192ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.040774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b649-edb3-41d1-8d1b-23af0f192ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.057554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:43.057711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d343b649-edb3-41d1-8d1b-23af0f192ac8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:43.059262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d343b649-edb3-41d1-8d1b-23af0f192ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:43.088585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:43.124576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd567-34b3-4562-bcf5-b549c93443af None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:43.128668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 536/1058] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:43.153375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343b649-edb3-41d1-8d1b-23af0f192ac8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.167490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:43.168152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.168441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.168721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.243823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:43.245283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:43.258448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343b649-edb3-41d1-8d1b-23af0f192ac8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:43.284832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:43.294721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:43.295533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.295815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.296089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.307498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:43.315565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:43.316525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:43.317410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 537/1059] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:43.323382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.355459 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 523/1060] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:43.358159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:43.361157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.437418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d5e2-7e94-4612-acaf-4f2a25cbf9c7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:43.474270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc1ae-19d9-4a03-975c-e018f55c7ca0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:43.477237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:43.477937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.478228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.478510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.479343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:43.479657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:43.481136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:43.490168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 538/1061] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:43.496364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.508953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:43.509822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.510107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.510382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.511542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] RBAC: Authorizing `identity:get_project(project_id=d452f7bb0fbe496795f1daf0b6f898d3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:43.512968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:43.514674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 524/1062] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:43.520519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.524172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:43.594070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:43.608539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135d6df-c332-4bae-b335-fa1669883a84 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:43.630386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af6e97-3457-4196-a18a-1dd00907f865 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:43.646174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:43.646967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.647255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.647532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.658693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:43.660144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:43.666603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:43.667269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.667554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.667833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.668651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3, user.id=1ed4831521774e23b9ebff97b6e8f8ca) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:43.668969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:43.670421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:43.676189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 525/1063] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/role_assignments?user.id=1ed4831521774e23b9ebff97b6e8f8ca&scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:43.678279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:43.679778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:43.685936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:43.685936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:43.685936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:43.685936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:43.685936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 539/1064] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:43.689616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.763998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:43.803471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfa347-37a3-4c47-95fe-ce84582adbd2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:43.840821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:43.841504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:43.841827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:43.842112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:43.842843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:43.843153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:43.844571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:43.857908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 526/1065] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:43.863377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:43.969625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79f394-9476-41b8-9485-f955c3966335 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.006583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.007411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.007700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.007984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.016413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.017839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.020434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:44.034652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:44.035653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:44.036610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:44.037991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 540/1066] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:44:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:44.041615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.142830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d2e36-9fa8-4984-8e80-d59076049833 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.169532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:44.179140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ddc84-28c4-4188-bfea-3a827b5b7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.179826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ddc84-28c4-4188-bfea-3a827b5b7bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.180116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ddc84-28c4-4188-bfea-3a827b5b7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.180404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ddc84-28c4-4188-bfea-3a827b5b7bb0 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.181240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ddc84-28c4-4188-bfea-3a827b5b7bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:44.181554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ddc84-28c4-4188-bfea-3a827b5b7bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.183030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ddc84-28c4-4188-bfea-3a827b5b7bb0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.200701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 527/1067] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:44.206241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.299781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1fd4c-098f-4b40-a6de-b1d78a2bb454 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.300095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1fd4c-098f-4b40-a6de-b1d78a2bb454 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.300492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1fd4c-098f-4b40-a6de-b1d78a2bb454 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.302110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 528/1068] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:44.307555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e32c-bf47-4451-822f-3f77d2a80db8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.307858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e32c-bf47-4451-822f-3f77d2a80db8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.308142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e32c-bf47-4451-822f-3f77d2a80db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.311452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b8bf-f1cd-4b59-bc43-516976891a94 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.324549 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5790e32c-bf47-4451-822f-3f77d2a80db8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:44.325739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5790e32c-bf47-4451-822f-3f77d2a80db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:44.347890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.348683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.349085 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.349416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.361409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.362912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:44.381203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:44.382822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:44.383749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:44.383749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:44.383749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:44.383749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:44.383749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 541/1069] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:44.391658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.404527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 529/1070] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:44.427011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e32c-bf47-4451-822f-3f77d2a80db8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.455381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:44.508265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230873c2-7049-4e55-ab4a-e03cd7aa168c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.530703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e32c-bf47-4451-822f-3f77d2a80db8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.543934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.544683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.544975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.545260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.546059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:44.546373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.547765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.552192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:44.560641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 542/1071] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:44.566721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.574262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.574915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.575205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.575488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.646523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.649191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.666899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8ee69-5187-42ab-8f2a-b72f82b44cf3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.682973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:44.706421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.707249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.707535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.707817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.714509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.716011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:44.729510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:44.730578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:44.731476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 543/1072] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:44.736840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.755306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 530/1073] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 09:44:44.761576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.779123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:44.856625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42823c93-aa46-47e2-973e-a6a8bdcdae50 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.870368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d1cb-f1c0-459d-9052-aac3a6e1a6f3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:44.895311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.895979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.896271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.896553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.897348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:44.897686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.899419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.906905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:44.907699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:44.907988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:44.908268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:44.916737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 544/1074] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:44.917792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.921853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:44.922772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:44.941275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:44.942271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:44.943194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:44.943194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:44.943194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:44.943194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:44.943194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 531/1075] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:44.949084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:44.953868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:45.020946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:45.025125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6544d45-80fb-4789-a912-d2c1f5fe3acc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:45.060744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444177d-21c7-4c7c-9e73-508395141331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:45.061638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444177d-21c7-4c7c-9e73-508395141331 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:45.061956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444177d-21c7-4c7c-9e73-508395141331 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:45.062195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9068-d6d9-4478-b53f-ccee1148ce9e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:45.062397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444177d-21c7-4c7c-9e73-508395141331 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/d89ce6057b2843f2bfbc5a143eb9300e/roles/ad0b575d79cd4ff19d7b15c7dec12940` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:45.064581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444177d-21c7-4c7c-9e73-508395141331 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=d89ce6057b2843f2bfbc5a143eb9300e, role_id=ad0b575d79cd4ff19d7b15c7dec12940)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:45.066067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444177d-21c7-4c7c-9e73-508395141331 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:45.080564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 545/1076] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:44:44 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/d89ce6057b2843f2bfbc5a143eb9300e/roles/ad0b575d79cd4ff19d7b15c7dec12940 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:44:45.104488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2e39e-957b-46f0-bae2-89eb8c4a0045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:45.105203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e39e-957b-46f0-bae2-89eb8c4a0045 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:45.105495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e39e-957b-46f0-bae2-89eb8c4a0045 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:45.105799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e39e-957b-46f0-bae2-89eb8c4a0045 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:45.106544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2e39e-957b-46f0-bae2-89eb8c4a0045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:45.106911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2e39e-957b-46f0-bae2-89eb8c4a0045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:45.108270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2e39e-957b-46f0-bae2-89eb8c4a0045 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:45.129792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 532/1077] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:45.947047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc5bf-a37e-4309-9e64-0077fe0f4216 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:45.947578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc5bf-a37e-4309-9e64-0077fe0f4216 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:45.947578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc5bf-a37e-4309-9e64-0077fe0f4216 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:45.948965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 546/1078] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:45.954070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b8d0-e340-4433-9e63-a9f45ee2ed1a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:45.954475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b8d0-e340-4433-9e63-a9f45ee2ed1a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:45.954734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b8d0-e340-4433-9e63-a9f45ee2ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:45.971084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ad15b8d0-e340-4433-9e63-a9f45ee2ed1a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:45.972260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad15b8d0-e340-4433-9e63-a9f45ee2ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:46.041011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 533/1079] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:46.063431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cc5bf-a37e-4309-9e64-0077fe0f4216 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:46.151645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:46.162293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cc5bf-a37e-4309-9e64-0077fe0f4216 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:46.195607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:46.196389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:46.196674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:46.196951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:46.207678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:46.215956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:46.217029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:46.218135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 547/1080] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:46.223299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b8d0-e340-4433-9e63-a9f45ee2ed1a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:46.278922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:46.320816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b8d0-e340-4433-9e63-a9f45ee2ed1a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:46.353729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:46.354419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:46.354705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:46.354981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:46.355769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:46.356082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:46.357447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:46.365316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 534/1081] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:46.371735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:46.469771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa214d-6d4e-442e-ae8b-048de3ff988e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:46.502291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:46.503144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:46.503427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:46.503700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] PATH_INFO: `/v3/users/1ed4831521774e23b9ebff97b6e8f8ca` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:46.504869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] RBAC: Authorizing `identity:get_user(user_id=1ed4831521774e23b9ebff97b6e8f8ca)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:46.506334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:46.508459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 548/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:44:46 2022] GET /identity/v3/users/1ed4831521774e23b9ebff97b6e8f8ca => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:46.514141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:46.610008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626e340-6268-4aaf-ab87-0d2d323b1aca None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:46.629195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:46.643594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cacb58-2097-43ae-a328-611d5c97c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:46.644449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cacb58-2097-43ae-a328-611d5c97c0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:46.644733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cacb58-2097-43ae-a328-611d5c97c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:46.645008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cacb58-2097-43ae-a328-611d5c97c0f0 None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:46.646272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cacb58-2097-43ae-a328-611d5c97c0f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d452f7bb0fbe496795f1daf0b6f898d3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:46.648011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cacb58-2097-43ae-a328-611d5c97c0f0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:46.649709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 535/1083] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:44:46 2022] GET /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:46.655578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:46.677548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:46.754042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60bbb0-a06a-4cea-9830-8589fcc79efe None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:46.787628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6dbbc-f5b0-463c-a8a9-aec121722025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:46.788534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6dbbc-f5b0-463c-a8a9-aec121722025 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:46.788820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6dbbc-f5b0-463c-a8a9-aec121722025 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:46.789097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6dbbc-f5b0-463c-a8a9-aec121722025 None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3/users/1ed4831521774e23b9ebff97b6e8f8ca/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:46.791065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6dbbc-f5b0-463c-a8a9-aec121722025 None admin] RBAC: Authorizing `identity:create_grant(project_id=d452f7bb0fbe496795f1daf0b6f898d3, user_id=1ed4831521774e23b9ebff97b6e8f8ca, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:46.792495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6dbbc-f5b0-463c-a8a9-aec121722025 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:46.806142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 549/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:44:46 2022] PUT /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3/users/1ed4831521774e23b9ebff97b6e8f8ca/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:44:47.355631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b10ac-e57d-4233-a00a-b5bed0174b85 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:47.356198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b10ac-e57d-4233-a00a-b5bed0174b85 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:47.356198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b10ac-e57d-4233-a00a-b5bed0174b85 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:47.357536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 536/1085] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:47.362787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a1d5-a470-43f4-aa1e-a591160f6267 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:47.363208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a1d5-a470-43f4-aa1e-a591160f6267 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:47.363358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a1d5-a470-43f4-aa1e-a591160f6267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:47.380692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-da41a1d5-a470-43f4-aa1e-a591160f6267 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:47.381901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-da41a1d5-a470-43f4-aa1e-a591160f6267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:47.450949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 550/1086] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:47.474505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b10ac-e57d-4233-a00a-b5bed0174b85 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:47.582532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b10ac-e57d-4233-a00a-b5bed0174b85 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:47.616765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:47.617498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:47.617820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:47.618099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:47.628414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:47.636418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:47.637350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 09:44:47.638424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:47.641899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 537/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Jun 3 09:44:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:47.643529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a1d5-a470-43f4-aa1e-a591160f6267 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:47.655924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:47.742334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a1d5-a470-43f4-aa1e-a591160f6267 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:47.775237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:47.775904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:47.776191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:47.776519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:47.777262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:47.777572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:47.778987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:47.790817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 551/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 3 09:44:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:47.798472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:47.846173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:47.895945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cb19d-2ca6-457f-b04d-368bfc210842 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:47.932688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:47.933477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:47.933776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:47.934066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:47.944001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:47.946056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:47.963405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:47.964360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:47.965274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:47.965274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:47.965274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:47.965274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:47.965274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 538/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:47.970302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:48.039685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:48.071998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3362e-31b0-47a2-a8a9-b92d6fe990b1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:48.105318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:48.106003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:48.106287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:48.106559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:48.107267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:48.107569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:48.108924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:48.122324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 552/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:48.127851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:48.223423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:48.227048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34373f-76e5-436c-8031-a9b062385083 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:48.260252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:48.261036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:48.261326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:48.261605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:48.268879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:48.270372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:44:48.284208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:48.285165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:48.286672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 539/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Jun 3 09:44:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:48.291582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:48.389871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae607a6-15d7-42cc-aa15-89196b7acb9c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:48.419244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:48.424540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:48.425208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:48.425498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:48.425804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:48.426642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:48.426955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:48.428384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:48.446202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 553/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Jun 3 09:44:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:48.451837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:48.549136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9e86-3c0a-4439-a996-757465ef046c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:48.582135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:48.582781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:48.583076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:48.583354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:48.609724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:48.649057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:48.650563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:48.748514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 540/1093] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:48.754298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:48.852560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f365-1cc0-4bea-b0ff-f7f53fa97701 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:48.885952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11525f5-edbc-4c0b-87b1-09e514128d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:48.886741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11525f5-edbc-4c0b-87b1-09e514128d75 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:48.887028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11525f5-edbc-4c0b-87b1-09e514128d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:48.887307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11525f5-edbc-4c0b-87b1-09e514128d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:48.897156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11525f5-edbc-4c0b-87b1-09e514128d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:48.898917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11525f5-edbc-4c0b-87b1-09e514128d75 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b11525f5-edbc-4c0b-87b1-09e514128d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:44:48.916523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:48.917584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:48.923224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:44:48.923224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:44:48.923224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:44:48.923224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:48.923224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 554/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:44:48.923586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:48.980569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:49.021009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bd150-07ff-4f82-b8d2-f263ffa54349 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.044858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080091d-2cde-47bd-a929-aa458b48fb9e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.045145 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080091d-2cde-47bd-a929-aa458b48fb9e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.045426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080091d-2cde-47bd-a929-aa458b48fb9e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.046831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 555/1095] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:44:49.051664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633031-b0ae-472a-b0c0-71d5ed834685 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.051953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633031-b0ae-472a-b0c0-71d5ed834685 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.052231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633031-b0ae-472a-b0c0-71d5ed834685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.055346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.056016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.056301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.056584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.057305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:49.057617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:49.059037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:49.069221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-30633031-b0ae-472a-b0c0-71d5ed834685 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:49.070335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 541/1096] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:49.070457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-30633031-b0ae-472a-b0c0-71d5ed834685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:49.075557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:49.108857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:49.140931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 556/1097] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:44:49.165428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633031-b0ae-472a-b0c0-71d5ed834685 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:49.180570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db4e7-6967-4297-b94c-8e5315201416 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.199939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:49.214940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.215730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.216019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.216303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.222907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:49.224350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:44:49.238366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:49.239309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:44:49.240211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 542/1098] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:49.245796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:49.264831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633031-b0ae-472a-b0c0-71d5ed834685 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.299625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.300416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.300700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.300974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.311823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:44:49.319978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:44:49.321009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:44:49.321912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 557/1099] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:44:49.327016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:49.345409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545030ef-09bc-41ff-9215-c6e09cfba713 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.358276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:49.379594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.380196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.380487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.380767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.381547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:49.381887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:49.383325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:49.394684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 543/1100] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:49.401412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:49.442986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e5df-d568-4646-8b54-7faa9fdee4f9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.446897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:49.477021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.477684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.478002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.478286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.479031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:49.479344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:49.480743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:49.488717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 558/1101] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:49.495274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:49.505763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2d3fc-f6ec-4613-9811-d0d2b14e0c30 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.539299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.539953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.540246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.540523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.541348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] RBAC: Adding query filter params (role.id=ad0b575d79cd4ff19d7b15c7dec12940, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=d89ce6057b2843f2bfbc5a143eb9300e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:49.541664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:49.543155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:49.549022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 544/1102] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/role_assignments?user.id=d89ce6057b2843f2bfbc5a143eb9300e&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=ad0b575d79cd4ff19d7b15c7dec12940 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:49.601764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:49.610546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05b102-0f02-47db-96a5-9e71a09801ae None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.647083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.648137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.648422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.648699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] PATH_INFO: `/v3/users/1ed4831521774e23b9ebff97b6e8f8ca` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.649990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed4831521774e23b9ebff97b6e8f8ca)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:49.651447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:49.653161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 559/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/users/1ed4831521774e23b9ebff97b6e8f8ca => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:44:49.659130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:49.762710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4d4b-aa35-407e-b764-62a27fa0b56f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:49.765052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:49.797716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:49.798495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:49.798780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:49.799058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:49.869047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:49.870555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:49.970337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 545/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:49.976759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:50.078104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122cdbf-2c13-4141-8a55-31ad88201d84 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:50.112682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d6e74-1cf2-43ef-b6ce-cffae1b1b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:50.113538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6e74-1cf2-43ef-b6ce-cffae1b1b216 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:50.113856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6e74-1cf2-43ef-b6ce-cffae1b1b216 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:50.114138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d6e74-1cf2-43ef-b6ce-cffae1b1b216 None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:50.115315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d6e74-1cf2-43ef-b6ce-cffae1b1b216 None admin] RBAC: Authorizing `identity:get_project(project_id=d452f7bb0fbe496795f1daf0b6f898d3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:50.116827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d6e74-1cf2-43ef-b6ce-cffae1b1b216 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:50.118611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 560/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:44:49 2022] GET /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:50.124706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:50.128023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:50.229110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801c18-ead2-4d20-ab19-442ae8019a35 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:50.263224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d769acf-c911-4bd3-a015-8614a42182b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:50.263888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769acf-c911-4bd3-a015-8614a42182b4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:50.264156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769acf-c911-4bd3-a015-8614a42182b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:50.264433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769acf-c911-4bd3-a015-8614a42182b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:50.265250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d769acf-c911-4bd3-a015-8614a42182b4 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3, user.id=1ed4831521774e23b9ebff97b6e8f8ca) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:50.265559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d769acf-c911-4bd3-a015-8614a42182b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:50.267112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d769acf-c911-4bd3-a015-8614a42182b4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:50.274082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 546/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:50 2022] GET /identity/v3/role_assignments?user.id=1ed4831521774e23b9ebff97b6e8f8ca&scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:52.519131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957e38-1d8b-49fc-a11a-e4eb34302d4c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:52.519652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957e38-1d8b-49fc-a11a-e4eb34302d4c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:52.519745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957e38-1d8b-49fc-a11a-e4eb34302d4c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:52.521044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 561/1107] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:52.526609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9cac-8f18-42a9-9110-b0f3b23c967f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:52.526993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9cac-8f18-42a9-9110-b0f3b23c967f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:52.527171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9cac-8f18-42a9-9110-b0f3b23c967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:52.543964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-432f9cac-8f18-42a9-9110-b0f3b23c967f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:52.545133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-432f9cac-8f18-42a9-9110-b0f3b23c967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:52.604533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:52.610104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 547/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:52.635620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6957e38-1d8b-49fc-a11a-e4eb34302d4c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:52.665899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:52.734790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6957e38-1d8b-49fc-a11a-e4eb34302d4c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:52.766821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636236d-7210-42c9-9753-3b39cbef65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:52.767588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636236d-7210-42c9-9753-3b39cbef65ee None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:52.767873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636236d-7210-42c9-9753-3b39cbef65ee None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:52.768147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636236d-7210-42c9-9753-3b39cbef65ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:52.769290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636236d-7210-42c9-9753-3b39cbef65ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:52.770733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636236d-7210-42c9-9753-3b39cbef65ee None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:52.772353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 562/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:52.778237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9cac-8f18-42a9-9110-b0f3b23c967f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:52.874880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9cac-8f18-42a9-9110-b0f3b23c967f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:52.907740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653995-2935-4268-90ad-8ed93d010fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:52.908393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653995-2935-4268-90ad-8ed93d010fbd None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:52.908674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653995-2935-4268-90ad-8ed93d010fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:52.908949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653995-2935-4268-90ad-8ed93d010fbd None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:52.909644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59653995-2935-4268-90ad-8ed93d010fbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:52.911092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59653995-2935-4268-90ad-8ed93d010fbd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:52.930328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 548/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:44:52 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:44:55.185358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934cedd-5bd8-4b80-8a58-0eda9c33da48 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:55.185918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934cedd-5bd8-4b80-8a58-0eda9c33da48 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:55.186029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934cedd-5bd8-4b80-8a58-0eda9c33da48 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:55.187322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 563/1111] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:55.192472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec32b8-fe2a-4a30-aeac-69ccbd12c5a8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:55.192856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec32b8-fe2a-4a30-aeac-69ccbd12c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:55.193042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec32b8-fe2a-4a30-aeac-69ccbd12c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:55.209336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-68ec32b8-fe2a-4a30-aeac-69ccbd12c5a8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:55.211067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-68ec32b8-fe2a-4a30-aeac-69ccbd12c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:55.258651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:55.276178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 549/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:55.299700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934cedd-5bd8-4b80-8a58-0eda9c33da48 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:55.394705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:55.399906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934cedd-5bd8-4b80-8a58-0eda9c33da48 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:55.432463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:55.433308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:55.433594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:55.433906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] PATH_INFO: `/v3/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:55.435415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] RBAC: Authorizing `identity:get_role(role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:55.436729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:55.438123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 564/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:44:55 2022] GET /identity/v3/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:55.443836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec32b8-fe2a-4a30-aeac-69ccbd12c5a8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:55.539411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec32b8-fe2a-4a30-aeac-69ccbd12c5a8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:55.572583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:55.573448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:55.573735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:55.574050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] PATH_INFO: `/v3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:55.586926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] RBAC: Authorizing `identity:get_user(user_id=ce6f26b1bc0c4e2c9d9dabdc4af16e80)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:55.588371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:55.590042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 550/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:44:55 2022] GET /identity/v3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:55.595733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:55.695964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20745af7-1876-4853-ac73-1ee082b8c6f2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:55.728040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:55.728675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:55.728960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:55.729238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:55.761156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:55.793972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:55.795428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:55.888611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 565/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:44:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:44:55.894485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:55.937828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:55.992711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd1fca-008f-469e-bc58-1c9f69b86eaf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:56.025743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a53f0f-6242-4a7a-87d2-c46777b9a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:56.026623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53f0f-6242-4a7a-87d2-c46777b9a485 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:56.026910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53f0f-6242-4a7a-87d2-c46777b9a485 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:56.027192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53f0f-6242-4a7a-87d2-c46777b9a485 None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:56.028351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a53f0f-6242-4a7a-87d2-c46777b9a485 None admin] RBAC: Authorizing `identity:get_project(project_id=d452f7bb0fbe496795f1daf0b6f898d3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:56.029792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a53f0f-6242-4a7a-87d2-c46777b9a485 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:56.031451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 551/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:44:55 2022] GET /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:56.037342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:56.099347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:56.132980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc76009-dcb7-49cf-bcbb-41f7a65b5c34 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:56.166327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6626-6894-426f-94d2-8fdee002b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:56.166960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6626-6894-426f-94d2-8fdee002b3db None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:56.167241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6626-6894-426f-94d2-8fdee002b3db None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:56.167521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6626-6894-426f-94d2-8fdee002b3db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:56.168329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6626-6894-426f-94d2-8fdee002b3db None admin] RBAC: Adding query filter params (role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3, user.id=ce6f26b1bc0c4e2c9d9dabdc4af16e80) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:44:56.168633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6626-6894-426f-94d2-8fdee002b3db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:56.170071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6626-6894-426f-94d2-8fdee002b3db None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:56.175316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 566/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:44:56 2022] GET /identity/v3/role_assignments?user.id=ce6f26b1bc0c4e2c9d9dabdc4af16e80&scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:58.363346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30122293-3dc8-4df1-aa4f-365431ab8e70 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:58.363921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30122293-3dc8-4df1-aa4f-365431ab8e70 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:58.363921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30122293-3dc8-4df1-aa4f-365431ab8e70 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:58.365267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 552/1118] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:44:58.370911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eb008-e9da-43eb-bd7f-e41039d0c6f9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:58.371303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eb008-e9da-43eb-bd7f-e41039d0c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:58.371467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eb008-e9da-43eb-bd7f-e41039d0c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:58.391027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f60eb008-e9da-43eb-bd7f-e41039d0c6f9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:44:58.391746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f60eb008-e9da-43eb-bd7f-e41039d0c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:44:58.455687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 567/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:44:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:44:58.478703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30122293-3dc8-4df1-aa4f-365431ab8e70 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:58.576618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30122293-3dc8-4df1-aa4f-365431ab8e70 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:58.586810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:58.610036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:58.610880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:58.611170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:58.611451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] PATH_INFO: `/v3/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:58.612911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] RBAC: Authorizing `identity:get_role(role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:58.614369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:58.615665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 553/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:44:58 2022] GET /identity/v3/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:58.621838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eb008-e9da-43eb-bd7f-e41039d0c6f9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:58.677882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:58.716801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eb008-e9da-43eb-bd7f-e41039d0c6f9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:58.749568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:58.750449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:58.750732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:58.751008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] PATH_INFO: `/v3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:58.752148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] RBAC: Authorizing `identity:get_user(user_id=ce6f26b1bc0c4e2c9d9dabdc4af16e80)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:58.753557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:58.755183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 568/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:44:58 2022] GET /identity/v3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:58.760705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:58.857528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38d4f-436a-491b-a7f4-7806ae8b1efc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:58.892968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17933194-34ca-4df1-861d-f9d73e2e3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:58.893776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17933194-34ca-4df1-861d-f9d73e2e3d4b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:58.894061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17933194-34ca-4df1-861d-f9d73e2e3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:58.894337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17933194-34ca-4df1-861d-f9d73e2e3d4b None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:58.895492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17933194-34ca-4df1-861d-f9d73e2e3d4b None admin] RBAC: Authorizing `identity:get_project(project_id=d452f7bb0fbe496795f1daf0b6f898d3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:58.896932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17933194-34ca-4df1-861d-f9d73e2e3d4b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:58.899444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 554/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:44:58 2022] GET /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:44:58.905370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:44:59.001252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138117-205a-4983-b43d-609dde54eec9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:44:59.027010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:44:59.035020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232c8b-f5f8-49d1-8b3f-b0beb47f299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:44:59.035888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232c8b-f5f8-49d1-8b3f-b0beb47f299e None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:44:59.036173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232c8b-f5f8-49d1-8b3f-b0beb47f299e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:44:59.036451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232c8b-f5f8-49d1-8b3f-b0beb47f299e None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:44:59.039222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232c8b-f5f8-49d1-8b3f-b0beb47f299e None admin] RBAC: Authorizing `identity:create_grant(project_id=d452f7bb0fbe496795f1daf0b6f898d3, user_id=ce6f26b1bc0c4e2c9d9dabdc4af16e80, role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:44:59.040663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232c8b-f5f8-49d1-8b3f-b0beb47f299e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:44:59.052580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 569/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:44:58 2022] PUT /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:45:01.263270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2a3d-2946-4d30-b82c-624b3648343d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:01.263800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2a3d-2946-4d30-b82c-624b3648343d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:01.263800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2a3d-2946-4d30-b82c-624b3648343d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:01.265176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 555/1124] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:01.270423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f290e6-d0d3-4855-9e06-c037af9e3375 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:01.270821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f290e6-d0d3-4855-9e06-c037af9e3375 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:01.270994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f290e6-d0d3-4855-9e06-c037af9e3375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:01.288301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-73f290e6-d0d3-4855-9e06-c037af9e3375 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:01.289559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-73f290e6-d0d3-4855-9e06-c037af9e3375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:01.354208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 570/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:01.377879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2a3d-2946-4d30-b82c-624b3648343d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:01.424776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:01.476369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2a3d-2946-4d30-b82c-624b3648343d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:01.508318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:01.509162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:01.509445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:01.509717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] PATH_INFO: `/v3/roles/2162e6e3e2ea4dacb883f85a41de974c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:01.511186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] RBAC: Authorizing `identity:get_role(role_id=2162e6e3e2ea4dacb883f85a41de974c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:01.512550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:01.514005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 556/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:01 2022] GET /identity/v3/roles/2162e6e3e2ea4dacb883f85a41de974c => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:01.519698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f290e6-d0d3-4855-9e06-c037af9e3375 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:01.621892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f290e6-d0d3-4855-9e06-c037af9e3375 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:01.638542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:01.656120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:01.656988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:01.657276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:01.657550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] PATH_INFO: `/v3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:01.658748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] RBAC: Authorizing `identity:get_user(user_id=ce6f26b1bc0c4e2c9d9dabdc4af16e80)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:01.660168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:01.661796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 571/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:01 2022] GET /identity/v3/users/ce6f26b1bc0c4e2c9d9dabdc4af16e80 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:01.668025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:01.769583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd279-784f-4e21-a1d2-447a46eb2546 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:01.783516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:01.802758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:01.803896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:01.804182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:01.804461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:01.868003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:01.869446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:01.962688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 557/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:45:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:45:01.968518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:02.064021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd1648-6435-4c86-bad3-70d230210327 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:02.096776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ce61-ca09-4066-96e6-ee81a99367d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:02.097616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ce61-ca09-4066-96e6-ee81a99367d2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:02.097932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ce61-ca09-4066-96e6-ee81a99367d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:02.098211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ce61-ca09-4066-96e6-ee81a99367d2 None admin] PATH_INFO: `/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:02.099368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8ce61-ca09-4066-96e6-ee81a99367d2 None admin] RBAC: Authorizing `identity:get_project(project_id=d452f7bb0fbe496795f1daf0b6f898d3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:02.100787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8ce61-ca09-4066-96e6-ee81a99367d2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:02.102547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 572/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:45:01 2022] GET /identity/v3/projects/d452f7bb0fbe496795f1daf0b6f898d3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:02.108366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:02.123295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:02.204926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60a63-aca8-48a5-9ba5-f5ef34fd4146 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:02.237517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60499822-bb76-43ea-bdc9-5b03d3bf7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:02.238189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499822-bb76-43ea-bdc9-5b03d3bf7b73 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:02.238477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499822-bb76-43ea-bdc9-5b03d3bf7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:02.238757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499822-bb76-43ea-bdc9-5b03d3bf7b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:02.239580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60499822-bb76-43ea-bdc9-5b03d3bf7b73 None admin] RBAC: Adding query filter params (role.id=2162e6e3e2ea4dacb883f85a41de974c, scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3, user.id=ce6f26b1bc0c4e2c9d9dabdc4af16e80) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:02.239896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60499822-bb76-43ea-bdc9-5b03d3bf7b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:02.241904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60499822-bb76-43ea-bdc9-5b03d3bf7b73 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:02.247655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 558/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:45:02 2022] GET /identity/v3/role_assignments?user.id=ce6f26b1bc0c4e2c9d9dabdc4af16e80&scope.project.id=d452f7bb0fbe496795f1daf0b6f898d3&role.id=2162e6e3e2ea4dacb883f85a41de974c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:04.514039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003883-041e-47cb-ba64-bbd6adb43687 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:04.514537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003883-041e-47cb-ba64-bbd6adb43687 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:04.514629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003883-041e-47cb-ba64-bbd6adb43687 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:04.516040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 573/1131] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:04.521176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22fa40-c220-4840-aff2-df5b24d82466 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:04.521606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22fa40-c220-4840-aff2-df5b24d82466 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:04.521739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22fa40-c220-4840-aff2-df5b24d82466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:04.538740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1c22fa40-c220-4840-aff2-df5b24d82466 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:04.539914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1c22fa40-c220-4840-aff2-df5b24d82466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:04.603511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 559/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:04.627590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003883-041e-47cb-ba64-bbd6adb43687 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:04.682807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:04.726248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003883-041e-47cb-ba64-bbd6adb43687 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:04.758664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27354cf7-a822-4831-b5e8-6cd6a184effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:04.759433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354cf7-a822-4831-b5e8-6cd6a184effa None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:04.759716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354cf7-a822-4831-b5e8-6cd6a184effa None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:04.759994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354cf7-a822-4831-b5e8-6cd6a184effa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:04.761152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27354cf7-a822-4831-b5e8-6cd6a184effa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:04.762639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27354cf7-a822-4831-b5e8-6cd6a184effa None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:04.764223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 574/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:45:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:04.770053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22fa40-c220-4840-aff2-df5b24d82466 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:04.780250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:04.866346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22fa40-c220-4840-aff2-df5b24d82466 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:04.900006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9890c87-b3c4-44f5-beb4-552a6a0d79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:04.900665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9890c87-b3c4-44f5-beb4-552a6a0d79a4 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:04.900956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9890c87-b3c4-44f5-beb4-552a6a0d79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:04.901240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9890c87-b3c4-44f5-beb4-552a6a0d79a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:04.901985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9890c87-b3c4-44f5-beb4-552a6a0d79a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:04.903863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9890c87-b3c4-44f5-beb4-552a6a0d79a4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:04.930694 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 560/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:45:04 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:45:07.186063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dadf5-3095-43b6-81c0-693b6cb54489 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:07.186614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dadf5-3095-43b6-81c0-693b6cb54489 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:07.186614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dadf5-3095-43b6-81c0-693b6cb54489 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:07.187993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 575/1135] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:07.193271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a889-823a-4e08-a6c8-363e770ab1c9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:07.193677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a889-823a-4e08-a6c8-363e770ab1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:07.193871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a889-823a-4e08-a6c8-363e770ab1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:07.210603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bce7a889-823a-4e08-a6c8-363e770ab1c9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:07.211782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bce7a889-823a-4e08-a6c8-363e770ab1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:07.264256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:07.276293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 561/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:07.300241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dadf5-3095-43b6-81c0-693b6cb54489 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:07.400393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dadf5-3095-43b6-81c0-693b6cb54489 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:07.422265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:07.434229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6b26b-7fc5-4f4e-b9b0-387f701eba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:07.435008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6b26b-7fc5-4f4e-b9b0-387f701eba3b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:07.435296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6b26b-7fc5-4f4e-b9b0-387f701eba3b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:07.435575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6b26b-7fc5-4f4e-b9b0-387f701eba3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:07.436749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6b26b-7fc5-4f4e-b9b0-387f701eba3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:07.438223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6b26b-7fc5-4f4e-b9b0-387f701eba3b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:07.439821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 576/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:45:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:45:07.446110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a889-823a-4e08-a6c8-363e770ab1c9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:07.541101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a889-823a-4e08-a6c8-363e770ab1c9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:07.573571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47cf93-b6bd-4e2a-9d3a-9fee0909d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:07.574261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cf93-b6bd-4e2a-9d3a-9fee0909d025 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:07.574551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cf93-b6bd-4e2a-9d3a-9fee0909d025 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:07.574834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cf93-b6bd-4e2a-9d3a-9fee0909d025 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:07.575535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47cf93-b6bd-4e2a-9d3a-9fee0909d025 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:07.576967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47cf93-b6bd-4e2a-9d3a-9fee0909d025 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:07.596421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 562/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:45:07 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:45:09.867870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfeb38-1513-4862-8679-0b6dd74117a0 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:09.868424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfeb38-1513-4862-8679-0b6dd74117a0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:09.868424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfeb38-1513-4862-8679-0b6dd74117a0 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:09.869830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 577/1139] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:09.875113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ca87-d6c0-425a-b7c7-1f958b868714 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:09.875553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ca87-d6c0-425a-b7c7-1f958b868714 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:09.875656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ca87-d6c0-425a-b7c7-1f958b868714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:09.891864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ed50ca87-d6c0-425a-b7c7-1f958b868714 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:09.893028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ed50ca87-d6c0-425a-b7c7-1f958b868714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:09.933365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:09.956633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 563/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:09.980205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfeb38-1513-4862-8679-0b6dd74117a0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:10.078636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfeb38-1513-4862-8679-0b6dd74117a0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:10.111773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:10.112545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:10.112829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:10.113113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:10.123021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:45:10.130474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:45:10.131604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:45:10.132705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 578/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:45:10.137523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ca87-d6c0-425a-b7c7-1f958b868714 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:10.231822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ca87-d6c0-425a-b7c7-1f958b868714 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:10.265337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:10.266026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:10.266316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:10.266599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:10.267340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:10.267648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:10.269017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:10.277044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 564/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:10.282602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:10.332229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:10.380822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec6e2-db5d-46ef-9ff4-ee146c4aef7a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:10.413947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:10.414807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:10.415092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:10.415371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] PATH_INFO: `/v3/users/03abec9e33374a9090164c0bb6c38cd5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:10.428011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] RBAC: Authorizing `identity:get_user(user_id=03abec9e33374a9090164c0bb6c38cd5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:10.430056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:10.431730 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 579/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:10 2022] GET /identity/v3/users/03abec9e33374a9090164c0bb6c38cd5 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:10.437560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:10.476696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:10.534580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06457290-e22d-4693-aade-f0dd3be5a371 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:10.567207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:10.567845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:10.568133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:10.568411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:10.632555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:10.633984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:10.670848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:10.728546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 565/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:45:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:45:10.734342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:10.830894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a75f8d-a431-4e09-a029-619dc036492c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:10.840326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:10.873283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078717b-4dec-4464-afb9-c1a772afce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:10.874162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078717b-4dec-4464-afb9-c1a772afce90 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:10.874450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078717b-4dec-4464-afb9-c1a772afce90 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:10.874732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078717b-4dec-4464-afb9-c1a772afce90 None admin] PATH_INFO: `/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:10.875906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078717b-4dec-4464-afb9-c1a772afce90 None admin] RBAC: Authorizing `identity:get_project(project_id=7e096300a55d4dfc9affaa0bf7a1964f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:10.877330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078717b-4dec-4464-afb9-c1a772afce90 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:10.879055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 580/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:45:10 2022] GET /identity/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:10.885191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:10.978961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878e2f-552e-4f5f-ace1-831d55e0d5ac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:11.011165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96701f09-15db-48bd-8c3e-4d6d642a2cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:11.011796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96701f09-15db-48bd-8c3e-4d6d642a2cde None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:11.012079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96701f09-15db-48bd-8c3e-4d6d642a2cde None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:11.012355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96701f09-15db-48bd-8c3e-4d6d642a2cde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:11.013166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96701f09-15db-48bd-8c3e-4d6d642a2cde None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=7e096300a55d4dfc9affaa0bf7a1964f, user.id=03abec9e33374a9090164c0bb6c38cd5) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:11.013475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96701f09-15db-48bd-8c3e-4d6d642a2cde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:11.014941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96701f09-15db-48bd-8c3e-4d6d642a2cde None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:11.020118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 566/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:45:10 2022] GET /identity/v3/role_assignments?user.id=03abec9e33374a9090164c0bb6c38cd5&scope.project.id=7e096300a55d4dfc9affaa0bf7a1964f&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:13.222705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439563bb-da6f-4b01-b545-066f82dde4f0 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:13.223233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439563bb-da6f-4b01-b545-066f82dde4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:13.223326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439563bb-da6f-4b01-b545-066f82dde4f0 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:13.224646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 581/1147] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:13.230170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551460-1c30-4ee6-957d-f89d9e048b54 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:13.230564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551460-1c30-4ee6-957d-f89d9e048b54 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:13.230736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551460-1c30-4ee6-957d-f89d9e048b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:13.235726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:13.248683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b0551460-1c30-4ee6-957d-f89d9e048b54 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:13.249895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b0551460-1c30-4ee6-957d-f89d9e048b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:13.313356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 567/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:13.336210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439563bb-da6f-4b01-b545-066f82dde4f0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:13.435553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439563bb-da6f-4b01-b545-066f82dde4f0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:13.468372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:13.469149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:13.469437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:13.469717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:13.480317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:45:13.487831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:45:13.488911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:45:13.489953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 582/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:45:13.495633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551460-1c30-4ee6-957d-f89d9e048b54 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:13.589649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551460-1c30-4ee6-957d-f89d9e048b54 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:13.618077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:13.623295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:13.623950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:13.624237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:13.624514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:13.625252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:13.625559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:13.626952 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:13.635359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 568/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:13.641100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:13.676136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:13.741323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624c2e1-87c7-48fb-9763-125b007303c1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:13.774459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:13.775306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:13.775589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:13.775864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] PATH_INFO: `/v3/users/03abec9e33374a9090164c0bb6c38cd5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:13.777037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] RBAC: Authorizing `identity:get_user(user_id=03abec9e33374a9090164c0bb6c38cd5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:13.778491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:13.780274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 583/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:13 2022] GET /identity/v3/users/03abec9e33374a9090164c0bb6c38cd5 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:13.785965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:13.882198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cb189-943a-47c2-a282-07356547bdce None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:13.914279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd816-8f99-4abb-b8a9-baf9cf0db48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:13.915123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd816-8f99-4abb-b8a9-baf9cf0db48f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:13.915414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd816-8f99-4abb-b8a9-baf9cf0db48f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:13.915695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd816-8f99-4abb-b8a9-baf9cf0db48f None admin] PATH_INFO: `/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:13.916863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dd816-8f99-4abb-b8a9-baf9cf0db48f None admin] RBAC: Authorizing `identity:get_project(project_id=7e096300a55d4dfc9affaa0bf7a1964f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:13.918334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dd816-8f99-4abb-b8a9-baf9cf0db48f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:13.920008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 569/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:45:13 2022] GET /identity/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:13.925852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:14.025605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8ff5-3000-49a6-bb7c-e5318c675285 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:14.027858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:14.058693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9118-d499-4819-be54-e2f5c64f58e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:14.059571 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9118-d499-4819-be54-e2f5c64f58e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:14.059853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9118-d499-4819-be54-e2f5c64f58e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:14.060130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9118-d499-4819-be54-e2f5c64f58e4 None admin] PATH_INFO: `/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f/users/03abec9e33374a9090164c0bb6c38cd5/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:14.062163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9118-d499-4819-be54-e2f5c64f58e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e096300a55d4dfc9affaa0bf7a1964f, user_id=03abec9e33374a9090164c0bb6c38cd5, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:14.063603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9118-d499-4819-be54-e2f5c64f58e4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:14.075991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 584/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:45:13 2022] PUT /identity/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f/users/03abec9e33374a9090164c0bb6c38cd5/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:45:16.306323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19b85-4172-43f9-be04-3fc0ff1b1ef4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:16.306878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19b85-4172-43f9-be04-3fc0ff1b1ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:16.306878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19b85-4172-43f9-be04-3fc0ff1b1ef4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:16.308253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 570/1154] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:16.313587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22a39-5f3d-46c8-8931-203463d76cd7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:16.313985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22a39-5f3d-46c8-8931-203463d76cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:16.314181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22a39-5f3d-46c8-8931-203463d76cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:16.330929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-95d22a39-5f3d-46c8-8931-203463d76cd7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:16.332082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-95d22a39-5f3d-46c8-8931-203463d76cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:16.396672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 585/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:16.419547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca19b85-4172-43f9-be04-3fc0ff1b1ef4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:16.480606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:16.518938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca19b85-4172-43f9-be04-3fc0ff1b1ef4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:16.551297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:16.552074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:16.552358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:16.552633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:16.563966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:45:16.571349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:45:16.572450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:45:16.573508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 571/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:45:16.578495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d22a39-5f3d-46c8-8931-203463d76cd7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:16.667493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:16.675226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d22a39-5f3d-46c8-8931-203463d76cd7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:16.709974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:16.710631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:16.710912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:16.711188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:16.711922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:16.712228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:16.713599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:16.721405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 586/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:16.727692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:16.824020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a895-2afa-4bdb-b989-f2f13a6509c8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:16.845842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:16.860172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:16.861030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:16.861320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:16.861600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] PATH_INFO: `/v3/users/03abec9e33374a9090164c0bb6c38cd5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:16.862823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] RBAC: Authorizing `identity:get_user(user_id=03abec9e33374a9090164c0bb6c38cd5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:16.864260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:16.866460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 572/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:16 2022] GET /identity/v3/users/03abec9e33374a9090164c0bb6c38cd5 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:16.872275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:16.969197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a53e0-6b72-4bf0-88af-2c414c24ae19 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:17.001601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:17.002267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:17.002557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:17.002839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:17.027312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:17.068741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:17.070751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:17.165419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 587/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:45:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:45:17.171153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:17.266640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeee781-08e7-4989-bafc-129185006d6d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:17.304582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7175ad3-33b1-4cd1-b71a-e77817ba1690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:17.305422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175ad3-33b1-4cd1-b71a-e77817ba1690 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:17.305710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175ad3-33b1-4cd1-b71a-e77817ba1690 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:17.306025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175ad3-33b1-4cd1-b71a-e77817ba1690 None admin] PATH_INFO: `/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:17.307196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175ad3-33b1-4cd1-b71a-e77817ba1690 None admin] RBAC: Authorizing `identity:get_project(project_id=7e096300a55d4dfc9affaa0bf7a1964f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:17.308635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175ad3-33b1-4cd1-b71a-e77817ba1690 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:17.310338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 573/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:45:17 2022] GET /identity/v3/projects/7e096300a55d4dfc9affaa0bf7a1964f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:17.316382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:17.370002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:17.413164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a145b-5bba-48ca-b1b4-3b7a0226c5d5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:17.445645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06d739-15c5-4036-a564-c8ad0f10acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:17.446315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d739-15c5-4036-a564-c8ad0f10acd9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:17.446601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d739-15c5-4036-a564-c8ad0f10acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:17.446879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d739-15c5-4036-a564-c8ad0f10acd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:17.447703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d739-15c5-4036-a564-c8ad0f10acd9 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=7e096300a55d4dfc9affaa0bf7a1964f, user.id=03abec9e33374a9090164c0bb6c38cd5) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:17.448016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d739-15c5-4036-a564-c8ad0f10acd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:17.449447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d739-15c5-4036-a564-c8ad0f10acd9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:17.455164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 588/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:45:17 2022] GET /identity/v3/role_assignments?user.id=03abec9e33374a9090164c0bb6c38cd5&scope.project.id=7e096300a55d4dfc9affaa0bf7a1964f&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:19.698926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17cd79-dbd2-4d17-ae2e-714fff879554 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:19.699447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17cd79-dbd2-4d17-ae2e-714fff879554 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:19.699555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17cd79-dbd2-4d17-ae2e-714fff879554 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:19.700851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 574/1162] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:45:19.706135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09cd22-38ee-41cd-8c4e-6436b777775c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:19.706560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09cd22-38ee-41cd-8c4e-6436b777775c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:19.706695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09cd22-38ee-41cd-8c4e-6436b777775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:19.723423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7a09cd22-38ee-41cd-8c4e-6436b777775c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:19.724581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7a09cd22-38ee-41cd-8c4e-6436b777775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:19.794190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 589/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:45:19.817239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17cd79-dbd2-4d17-ae2e-714fff879554 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:19.874819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:19.916735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17cd79-dbd2-4d17-ae2e-714fff879554 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:19.949601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:19.950211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:19.950497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:19.950778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:20.015073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:20.016521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:20.070606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:20.111619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 575/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:45:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:45:20.118151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09cd22-38ee-41cd-8c4e-6436b777775c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:20.167156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:20.215505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09cd22-38ee-41cd-8c4e-6436b777775c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:20.248450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446034aa-d759-4ed0-878a-2642844e9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:20.249235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446034aa-d759-4ed0-878a-2642844e9a8a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:20.249519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446034aa-d759-4ed0-878a-2642844e9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:20.249819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446034aa-d759-4ed0-878a-2642844e9a8a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:20.256254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446034aa-d759-4ed0-878a-2642844e9a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:20.257694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446034aa-d759-4ed0-878a-2642844e9a8a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-446034aa-d759-4ed0-878a-2642844e9a8a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:45:20.271392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:45:20.273119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:45:20.274637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 590/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:45:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:45:20.278807 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:20.381380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa82c-798c-4dc9-9b1a-220551d5e024 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:20.418167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5d956-4a39-44d9-8fe2-81dee0bf20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:20.418829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5d956-4a39-44d9-8fe2-81dee0bf20bb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:20.419113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5d956-4a39-44d9-8fe2-81dee0bf20bb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:20.419393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5d956-4a39-44d9-8fe2-81dee0bf20bb None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:20.420102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5d956-4a39-44d9-8fe2-81dee0bf20bb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:20.420408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5d956-4a39-44d9-8fe2-81dee0bf20bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:20.421781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5d956-4a39-44d9-8fe2-81dee0bf20bb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:20.429244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 576/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Jun 3 09:45:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:22.652154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69a68-5874-43d2-b3e4-b4fc0d1ed7e7 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:22.652659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69a68-5874-43d2-b3e4-b4fc0d1ed7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:22.652659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69a68-5874-43d2-b3e4-b4fc0d1ed7e7 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:22.654016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 591/1167] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:22.659187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e6e5-deff-44fb-b3b1-3ccf6a814494 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:22.659574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e6e5-deff-44fb-b3b1-3ccf6a814494 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:22.659753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e6e5-deff-44fb-b3b1-3ccf6a814494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:22.677095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a501e6e5-deff-44fb-b3b1-3ccf6a814494 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:22.678896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a501e6e5-deff-44fb-b3b1-3ccf6a814494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:22.694795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:22.743701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 577/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:22.766110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69a68-5874-43d2-b3e4-b4fc0d1ed7e7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:22.863929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69a68-5874-43d2-b3e4-b4fc0d1ed7e7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:22.873665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:22.895709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bee91-71c1-4236-b803-7f0ef88707c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:22.896343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bee91-71c1-4236-b803-7f0ef88707c7 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:22.896626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bee91-71c1-4236-b803-7f0ef88707c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:22.897419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bee91-71c1-4236-b803-7f0ef88707c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:22.898179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bee91-71c1-4236-b803-7f0ef88707c7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:22.899785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bee91-71c1-4236-b803-7f0ef88707c7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:22.913264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 592/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Fri Jun 3 09:45:22 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:45:25.167287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dfc4a-d91b-45f3-a1d7-12775ae6c1df None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:25.167850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dfc4a-d91b-45f3-a1d7-12775ae6c1df None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:25.167850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dfc4a-d91b-45f3-a1d7-12775ae6c1df None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:25.169216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 578/1170] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:25.174349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8daf-146e-4e4a-82b1-a38cbcbf112f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:25.174731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8daf-146e-4e4a-82b1-a38cbcbf112f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:25.174920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8daf-146e-4e4a-82b1-a38cbcbf112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:25.191772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-205d8daf-146e-4e4a-82b1-a38cbcbf112f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:25.192946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-205d8daf-146e-4e4a-82b1-a38cbcbf112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:25.257160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 593/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:25.280590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dfc4a-d91b-45f3-a1d7-12775ae6c1df None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:25.377598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dfc4a-d91b-45f3-a1d7-12775ae6c1df None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:25.410669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6a05b-2df4-4c31-bc11-e5eaa25396cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:25.411515 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6a05b-2df4-4c31-bc11-e5eaa25396cc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:25.411797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6a05b-2df4-4c31-bc11-e5eaa25396cc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:25.412072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6a05b-2df4-4c31-bc11-e5eaa25396cc None admin] PATH_INFO: `/v3/domains/70a111edeac2462cbd227255594d82af` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:25.422107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6a05b-2df4-4c31-bc11-e5eaa25396cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=70a111edeac2462cbd227255594d82af)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:25.423507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6a05b-2df4-4c31-bc11-e5eaa25396cc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:25.425103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 579/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Jun 3 09:45:25 2022] GET /identity/v3/domains/70a111edeac2462cbd227255594d82af => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:25.431383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d8daf-146e-4e4a-82b1-a38cbcbf112f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:25.523064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:25.526000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d8daf-146e-4e4a-82b1-a38cbcbf112f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:25.560112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6812b3-63dc-4753-8120-57a2c938c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:25.560755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6812b3-63dc-4753-8120-57a2c938c29a None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:25.561047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6812b3-63dc-4753-8120-57a2c938c29a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:25.561325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6812b3-63dc-4753-8120-57a2c938c29a None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:25.562067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6812b3-63dc-4753-8120-57a2c938c29a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:25.563494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6812b3-63dc-4753-8120-57a2c938c29a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:25.586868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 594/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:45:25 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:45:27.929912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188334d-46ab-4eb2-86f3-e7f3c7bb782e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:27.930500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188334d-46ab-4eb2-86f3-e7f3c7bb782e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:27.930500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188334d-46ab-4eb2-86f3-e7f3c7bb782e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:27.931841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 580/1174] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:27.937045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91443-e43b-4e4c-8bf3-2ae10b769c83 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:27.937443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91443-e43b-4e4c-8bf3-2ae10b769c83 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:27.937617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91443-e43b-4e4c-8bf3-2ae10b769c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:27.954155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-32c91443-e43b-4e4c-8bf3-2ae10b769c83 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:27.955327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-32c91443-e43b-4e4c-8bf3-2ae10b769c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:28.020158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 595/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:28.045818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188334d-46ab-4eb2-86f3-e7f3c7bb782e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:28.061121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:28.143923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188334d-46ab-4eb2-86f3-e7f3c7bb782e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:28.176878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b90008-5dda-4a69-8e00-49c835203f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:28.177731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90008-5dda-4a69-8e00-49c835203f84 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:28.178570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90008-5dda-4a69-8e00-49c835203f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:28.178850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90008-5dda-4a69-8e00-49c835203f84 None admin] PATH_INFO: `/v3/domains/70a111edeac2462cbd227255594d82af` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:28.180069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b90008-5dda-4a69-8e00-49c835203f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=70a111edeac2462cbd227255594d82af)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:28.181447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b90008-5dda-4a69-8e00-49c835203f84 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:28.183073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 581/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Jun 3 09:45:28 2022] GET /identity/v3/domains/70a111edeac2462cbd227255594d82af => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:28.188641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c91443-e43b-4e4c-8bf3-2ae10b769c83 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:28.267140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:28.285703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c91443-e43b-4e4c-8bf3-2ae10b769c83 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:28.318387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce45aa-3b3a-4e5d-9a5f-0f0ee1dec10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:28.319571 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce45aa-3b3a-4e5d-9a5f-0f0ee1dec10b None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:28.319857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce45aa-3b3a-4e5d-9a5f-0f0ee1dec10b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:28.320137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce45aa-3b3a-4e5d-9a5f-0f0ee1dec10b None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:28.320847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce45aa-3b3a-4e5d-9a5f-0f0ee1dec10b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:28.322300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce45aa-3b3a-4e5d-9a5f-0f0ee1dec10b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:28.341354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 596/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:45:28 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:45:30.599873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73ce85-39cd-4d35-844e-a33b7e9aa264 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:30.600448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73ce85-39cd-4d35-844e-a33b7e9aa264 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:30.600448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73ce85-39cd-4d35-844e-a33b7e9aa264 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:30.601847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 582/1178] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:30.607127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee087d-e7b1-48d1-ba21-364ccda0c1be None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:30.607525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee087d-e7b1-48d1-ba21-364ccda0c1be None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:30.607771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee087d-e7b1-48d1-ba21-364ccda0c1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:30.625453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3bee087d-e7b1-48d1-ba21-364ccda0c1be None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:30.626665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3bee087d-e7b1-48d1-ba21-364ccda0c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:30.691409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 597/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:45:30.714845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73ce85-39cd-4d35-844e-a33b7e9aa264 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:30.793897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:30.813767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73ce85-39cd-4d35-844e-a33b7e9aa264 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:30.845298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:30.846094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:30.846382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:30.846658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:30.859104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:45:30.870475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:45:30.871645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:45:30.872576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 583/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:45:30.877676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee087d-e7b1-48d1-ba21-364ccda0c1be None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:30.940947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:30.972781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee087d-e7b1-48d1-ba21-364ccda0c1be None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:31.004894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:31.005552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:31.005880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:31.006653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:31.007394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:31.007702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:31.009069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:31.016962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 598/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:31.023145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:31.117597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de188e-f314-4b92-aa77-b1aaa8dde3eb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:31.155329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:31.156192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:31.156475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:31.156754 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] PATH_INFO: `/v3/users/4f81cd33ee2b4b31919fc812a14c7274` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:31.167997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:31.171819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] RBAC: Authorizing `identity:get_user(user_id=4f81cd33ee2b4b31919fc812a14c7274)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:31.173265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:31.174953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 584/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:31 2022] GET /identity/v3/users/4f81cd33ee2b4b31919fc812a14c7274 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:31.180764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:31.277281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be3c4c-fdcd-49c2-9f72-55edaba0e155 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:31.305037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:31.311181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:31.311824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:31.312113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:31.312392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:31.378112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:31.379586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:31.475321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 599/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:45:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:45:31.481152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:31.580512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9da4-3c0a-4a10-99a4-b2fcb53743b4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:31.613363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae502c-5bd5-4765-a627-36764755ad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:31.614241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae502c-5bd5-4765-a627-36764755ad7d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:31.614525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae502c-5bd5-4765-a627-36764755ad7d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:31.614798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae502c-5bd5-4765-a627-36764755ad7d None admin] PATH_INFO: `/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:31.616543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae502c-5bd5-4765-a627-36764755ad7d None admin] RBAC: Authorizing `identity:get_project(project_id=8f0b0d18c0b04f1dbc9f186dd9c103d6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:31.618025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae502c-5bd5-4765-a627-36764755ad7d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:31.619695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 585/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:45:31 2022] GET /identity/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:31.625768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:31.654384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:31.721648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5ed8a-ae06-412b-aaca-2e2d154d13f0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:31.754002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8534a-2c59-4214-a0a2-7db51c4012f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:31.754638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8534a-2c59-4214-a0a2-7db51c4012f2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:31.754923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8534a-2c59-4214-a0a2-7db51c4012f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:31.755203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8534a-2c59-4214-a0a2-7db51c4012f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:31.756028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8534a-2c59-4214-a0a2-7db51c4012f2 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=8f0b0d18c0b04f1dbc9f186dd9c103d6, user.id=4f81cd33ee2b4b31919fc812a14c7274) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:31.756857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8534a-2c59-4214-a0a2-7db51c4012f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:31.758391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8534a-2c59-4214-a0a2-7db51c4012f2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:31.763905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 600/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:45:31 2022] GET /identity/v3/role_assignments?user.id=4f81cd33ee2b4b31919fc812a14c7274&scope.project.id=8f0b0d18c0b04f1dbc9f186dd9c103d6&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:33.976401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de7ad-102c-4849-b842-9976ad819eff None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:33.976946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de7ad-102c-4849-b842-9976ad819eff None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:33.976946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de7ad-102c-4849-b842-9976ad819eff None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:33.978350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 586/1186] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:33.983590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3030db-3569-49be-95ba-1e259cd2943c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:33.983960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3030db-3569-49be-95ba-1e259cd2943c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:33.984153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3030db-3569-49be-95ba-1e259cd2943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:34.001146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7a3030db-3569-49be-95ba-1e259cd2943c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:34.002390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7a3030db-3569-49be-95ba-1e259cd2943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:34.067868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 601/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:34.090592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196de7ad-102c-4849-b842-9976ad819eff None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:34.154692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:34.188090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196de7ad-102c-4849-b842-9976ad819eff None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:34.221929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:34.222710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:34.222993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:34.223272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:34.233516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:45:34.240999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:45:34.242099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:45:34.243295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 587/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:45:34.248170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3030db-3569-49be-95ba-1e259cd2943c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:34.272832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:34.345681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3030db-3569-49be-95ba-1e259cd2943c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:34.378396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:34.379062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:34.379350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:34.379631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:34.380377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:34.380686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:34.382134 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:34.391797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 602/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:34.398185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:34.494913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7739e8-0c7b-4443-8b52-839cc2625f11 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:34.518522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:34.527379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:34.528233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:34.528517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:34.528796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] PATH_INFO: `/v3/users/4f81cd33ee2b4b31919fc812a14c7274` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:34.529992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] RBAC: Authorizing `identity:get_user(user_id=4f81cd33ee2b4b31919fc812a14c7274)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:34.531427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:34.533012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 588/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:34 2022] GET /identity/v3/users/4f81cd33ee2b4b31919fc812a14c7274 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:45:34.539074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:34.622177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:34.637346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85f4a-c579-4895-a606-70fa33ef28cb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:34.669911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b40be-b8b6-4970-8bf5-37fc593e9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:34.670755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b40be-b8b6-4970-8bf5-37fc593e9aef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:34.671040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b40be-b8b6-4970-8bf5-37fc593e9aef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:34.671326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b40be-b8b6-4970-8bf5-37fc593e9aef None admin] PATH_INFO: `/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:34.672493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b40be-b8b6-4970-8bf5-37fc593e9aef None admin] RBAC: Authorizing `identity:get_project(project_id=8f0b0d18c0b04f1dbc9f186dd9c103d6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:34.673941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b40be-b8b6-4970-8bf5-37fc593e9aef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:34.675620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 603/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:45:34 2022] GET /identity/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:34.681558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:34.778284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c66a-76b6-49d8-ac75-5bb8286bf0e6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:34.810560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c623c7-abf7-4093-957c-d7034b68028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:34.811436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c623c7-abf7-4093-957c-d7034b68028d None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:34.811724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c623c7-abf7-4093-957c-d7034b68028d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:34.812004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c623c7-abf7-4093-957c-d7034b68028d None admin] PATH_INFO: `/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6/users/4f81cd33ee2b4b31919fc812a14c7274/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:34.813977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c623c7-abf7-4093-957c-d7034b68028d None admin] RBAC: Authorizing `identity:create_grant(project_id=8f0b0d18c0b04f1dbc9f186dd9c103d6, user_id=4f81cd33ee2b4b31919fc812a14c7274, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:34.815412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c623c7-abf7-4093-957c-d7034b68028d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:34.828336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 589/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:45:34 2022] PUT /identity/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6/users/4f81cd33ee2b4b31919fc812a14c7274/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:45:37.029738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7b737-9f29-487c-888a-5cbf2530c0ed None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:37.030332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7b737-9f29-487c-888a-5cbf2530c0ed None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:37.030332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7b737-9f29-487c-888a-5cbf2530c0ed None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:37.031726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 604/1193] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:45:37.037184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a35d32-828b-45db-93f1-481ff0e11602 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:37.037621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a35d32-828b-45db-93f1-481ff0e11602 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:37.037788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a35d32-828b-45db-93f1-481ff0e11602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:37.054558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-27a35d32-828b-45db-93f1-481ff0e11602 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:45:37.055731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-27a35d32-828b-45db-93f1-481ff0e11602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:45:37.102540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:37.120249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 590/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:45:37.144053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7b737-9f29-487c-888a-5cbf2530c0ed None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:37.242864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7b737-9f29-487c-888a-5cbf2530c0ed None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:37.275509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:37.276274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:37.276557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:37.276832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:37.287149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:45:37.294506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:45:37.295640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:45:37.301376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 605/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:45:37.302294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a35d32-828b-45db-93f1-481ff0e11602 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:37.395642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a35d32-828b-45db-93f1-481ff0e11602 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:37.428438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:37.429098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:37.429383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:37.429660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:37.430419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:37.430726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:37.432105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:37.439845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 591/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:45:37.446225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:37.461160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:37.542062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b38c7-f97d-4b36-b028-1db6e972a92d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:37.574445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:37.575287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:37.575572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:37.575850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] PATH_INFO: `/v3/users/4f81cd33ee2b4b31919fc812a14c7274` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:37.577019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] RBAC: Authorizing `identity:get_user(user_id=4f81cd33ee2b4b31919fc812a14c7274)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:37.578468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:37.580055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 606/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Jun 3 09:45:37 2022] GET /identity/v3/users/4f81cd33ee2b4b31919fc812a14c7274 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:37.585586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:37.631334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:37.682451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc35a-772d-4194-8fae-1645c007dc4b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:37.713608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:37.714260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:37.714547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:37.714829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:37.779045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:37.780489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:37.822535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:37.876506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 592/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:45:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:45:37.882468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:37.961697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:37.980231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981f038-b2e2-488f-97ea-9169d10577b1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:38.013816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1659-726e-43f5-9363-d8bf0ffb8ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:38.014657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1659-726e-43f5-9363-d8bf0ffb8ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:38.014945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1659-726e-43f5-9363-d8bf0ffb8ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:38.015227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1659-726e-43f5-9363-d8bf0ffb8ac2 None admin] PATH_INFO: `/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:38.016404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1659-726e-43f5-9363-d8bf0ffb8ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=8f0b0d18c0b04f1dbc9f186dd9c103d6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:38.017865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1659-726e-43f5-9363-d8bf0ffb8ac2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:38.019555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 607/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Jun 3 09:45:37 2022] GET /identity/v3/projects/8f0b0d18c0b04f1dbc9f186dd9c103d6 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:38.025948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:45:38.120415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed399a-b02f-4485-af89-e4c17161040a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:45:38.152683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b619efd-d887-42d8-8581-0585a6430155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:45:38.153312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619efd-d887-42d8-8581-0585a6430155 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:45:38.153598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619efd-d887-42d8-8581-0585a6430155 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:45:38.154043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619efd-d887-42d8-8581-0585a6430155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:45:38.154859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b619efd-d887-42d8-8581-0585a6430155 None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=8f0b0d18c0b04f1dbc9f186dd9c103d6, user.id=4f81cd33ee2b4b31919fc812a14c7274) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:45:38.155167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b619efd-d887-42d8-8581-0585a6430155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:45:38.156583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b619efd-d887-42d8-8581-0585a6430155 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:45:38.162190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 593/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:45:38 2022] GET /identity/v3/role_assignments?user.id=4f81cd33ee2b4b31919fc812a14c7274&scope.project.id=8f0b0d18c0b04f1dbc9f186dd9c103d6&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:45:48.009666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=25 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:45:48.159605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:39.529885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faec2b-ced8-49a8-bd90-b5f95edc3c0e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:39.530478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faec2b-ced8-49a8-bd90-b5f95edc3c0e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:39.530478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faec2b-ced8-49a8-bd90-b5f95edc3c0e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:39.532280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 608/1201] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:46:39.538854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13725-5fbc-465d-9d25-f8520af359db None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:39.539450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13725-5fbc-465d-9d25-f8520af359db None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:39.539450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13725-5fbc-465d-9d25-f8520af359db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:39.564540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-56a13725-5fbc-465d-9d25-f8520af359db None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:46:39.565795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-56a13725-5fbc-465d-9d25-f8520af359db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:46:39.653990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 594/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:46:39.680747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faec2b-ced8-49a8-bd90-b5f95edc3c0e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:39.825785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faec2b-ced8-49a8-bd90-b5f95edc3c0e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:39.881328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:39.882182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:39.882451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:39.882735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:39.896639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:39.898572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:39.920419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:39.921463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:39.922707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:39.922707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:39.922707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:39.922707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:39.922707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 609/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:46:39.932669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13725-5fbc-465d-9d25-f8520af359db None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:40.070693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13725-5fbc-465d-9d25-f8520af359db None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:40.107017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:40.120105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d7e2-bc4e-46ea-8ab5-83fbc7b3eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:40.121106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d7e2-bc4e-46ea-8ab5-83fbc7b3eb31 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:40.121403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d7e2-bc4e-46ea-8ab5-83fbc7b3eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:40.121720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d7e2-bc4e-46ea-8ab5-83fbc7b3eb31 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:40.122792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d7e2-bc4e-46ea-8ab5-83fbc7b3eb31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:40.123198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d7e2-bc4e-46ea-8ab5-83fbc7b3eb31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:40.124840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d7e2-bc4e-46ea-8ab5-83fbc7b3eb31 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:40.144932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 595/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:40.146822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:40.212421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:40.284230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291937bc-2c6b-4634-90ef-a652095a38de None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:40.331059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9023b9-ea53-484f-9aea-280b4e78e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:40.331870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9023b9-ea53-484f-9aea-280b4e78e507 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:40.332224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9023b9-ea53-484f-9aea-280b4e78e507 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:40.332535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9023b9-ea53-484f-9aea-280b4e78e507 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:40.333396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9023b9-ea53-484f-9aea-280b4e78e507 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:40.335033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9023b9-ea53-484f-9aea-280b4e78e507 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:40.361603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 610/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Jun 3 09:46:40 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:46:42.820255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e2c6a-0748-42a5-b09a-86f6d605f367 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:42.820822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e2c6a-0748-42a5-b09a-86f6d605f367 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:42.820822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e2c6a-0748-42a5-b09a-86f6d605f367 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:42.822383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 596/1206] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:46:42.827744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4cc4c-094e-46ac-b791-41aa741acc6a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:42.828176 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4cc4c-094e-46ac-b791-41aa741acc6a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:42.828391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4cc4c-094e-46ac-b791-41aa741acc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:42.847738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-acc4cc4c-094e-46ac-b791-41aa741acc6a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:46:42.848991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-acc4cc4c-094e-46ac-b791-41aa741acc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:46:42.929842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 611/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:46:42.957630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e2c6a-0748-42a5-b09a-86f6d605f367 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:43.082691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e2c6a-0748-42a5-b09a-86f6d605f367 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:43.126468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:43.127218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:43.127536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:43.127856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:43.140117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:46:43.147894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:43.149108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:43.150271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 597/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:46:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:46:43.155593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4cc4c-094e-46ac-b791-41aa741acc6a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:43.206835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:43.279888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4cc4c-094e-46ac-b791-41aa741acc6a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:43.323046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:43.324094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:43.324545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:43.324959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:43.326027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:43.326539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:43.328325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:43.342352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 612/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:46:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:43.347870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:43.413405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:43.474747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ec6bf-82f5-4dc2-8c50-cd993039acf7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:43.519893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:43.521039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:43.521191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:43.521455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:43.533343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:43.534928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:43.554441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:43.556021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:43.557461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:43.557461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:43.557461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:43.557461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:43.557461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 598/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:46:43.562106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:43.686137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:43.690801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc372d14-c352-4479-bd3a-6b8685306210 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:43.735767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:43.736536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:43.736816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:43.737117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:43.737910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:43.738324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:43.740326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:43.753784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 613/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:43.759122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:43.877272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ae66-74b0-46e6-a475-7dbcf19f979e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:43.879286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:43.919476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:43.920297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:43.920580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:43.920858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:43.930045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:43.931550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:46:43.948499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:43.949917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:43.951202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 599/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:46:43.958409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:44.089702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a678d0-f05d-4c6d-b656-a236f82cc887 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:44.135180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:44.135853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:44.136206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:44.136518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:44.137456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:44.137791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:44.139536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:44.158933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 614/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 3 09:46:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:44.166516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:44.280999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712fe5-fb64-4319-ac90-5241837560c1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:44.318436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:44.319110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:44.319449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:44.319733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:44.353086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:44.405237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:44.406803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:44.527860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 600/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:46:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:46:44.533642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:44.555972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:44.650446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898dd01-ee3d-4c68-a625-6cac1aea43b9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:44.685658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:44.686745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:44.687199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:44.687634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:44.698965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:44.700596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:44.720182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:44.721400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:44.722569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:44.722569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:44.722569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:44.722569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:44.728565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 615/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:44.729558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:44.796849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:44.841849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f532-7c44-481b-9639-b55bb71a4f13 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:44.879763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:44.880633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:44.881012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:44.881301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:44.882243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:44.882516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:44.884116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:44.901461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 601/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:44.902883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:44.984161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:45.024219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601261c-6572-4661-83b2-298ac5ca0fbc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:45.064498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:45.065470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:45.065921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:45.066335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:45.074019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:45.075640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:46:45.091003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:45.091967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:45.092919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 616/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:45.098214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:45.212850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959457f-1e23-4014-be69-21a42ea1acc8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:45.241221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:45.257658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e28c7-50b3-4c29-b457-2b60206bc576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:45.258519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e28c7-50b3-4c29-b457-2b60206bc576 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:45.258979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e28c7-50b3-4c29-b457-2b60206bc576 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:45.259420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e28c7-50b3-4c29-b457-2b60206bc576 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:45.260532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e28c7-50b3-4c29-b457-2b60206bc576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:45.260984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e28c7-50b3-4c29-b457-2b60206bc576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:45.262760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e28c7-50b3-4c29-b457-2b60206bc576 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:45.279107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 602/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:45.285948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:45.431260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ff87-6a2e-4e0e-a56d-5eb5a7fb707e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:45.471616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:45.478703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87dc28-2a08-40a2-aefa-4952f9353691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:45.479430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87dc28-2a08-40a2-aefa-4952f9353691 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:45.479714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87dc28-2a08-40a2-aefa-4952f9353691 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:45.479974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87dc28-2a08-40a2-aefa-4952f9353691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:45.480827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87dc28-2a08-40a2-aefa-4952f9353691 None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=33c559aafd5f4ebdbc3bb654926d2c5c) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:45.481145 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87dc28-2a08-40a2-aefa-4952f9353691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:45.482692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87dc28-2a08-40a2-aefa-4952f9353691 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:45.494120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 617/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:46:45 2022] GET /identity/v3/role_assignments?user.id=33c559aafd5f4ebdbc3bb654926d2c5c&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:47.982731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242930-d184-45ac-a42b-bb81a349ff02 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:47.983337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242930-d184-45ac-a42b-bb81a349ff02 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:47.983337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242930-d184-45ac-a42b-bb81a349ff02 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:47.984936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 603/1220] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:46:47.990913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f794d-ec66-4d3d-9eda-ed9541b384b0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:47.991329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f794d-ec66-4d3d-9eda-ed9541b384b0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:47.991525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f794d-ec66-4d3d-9eda-ed9541b384b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:48.010368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b56f794d-ec66-4d3d-9eda-ed9541b384b0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:46:48.011908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b56f794d-ec66-4d3d-9eda-ed9541b384b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:46:48.093989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 618/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:46:48.118758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242930-d184-45ac-a42b-bb81a349ff02 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:48.245115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242930-d184-45ac-a42b-bb81a349ff02 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:48.288978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:48.290005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:48.290464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:48.290830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:48.305685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:46:48.315201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:48.316237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:46:48.317134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:48.324915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 604/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:46:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:48.325133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f794d-ec66-4d3d-9eda-ed9541b384b0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:48.456145 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f794d-ec66-4d3d-9eda-ed9541b384b0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:48.482548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:48.494649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:48.495383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:48.495606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:48.495897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:48.496636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:48.497973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:48.498505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:48.508190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 619/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:46:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:48.514465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:48.563591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:48.629924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59406165-55ac-4978-9e88-bf72f52c70e6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:48.668779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:48.669607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:48.669963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:48.670247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:48.682847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:48.684362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:48.704288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:48.705384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:48.706572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:48.706572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:48.706572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:48.706572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:48.711117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 605/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:48.712014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:48.815322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f2d77-8f99-4998-8435-ae0f8153644b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:48.850324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:48.850996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:48.851282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:48.851560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:48.852280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:48.852586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:48.854056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:48.871346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 620/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:48.877055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:48.981937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:48.989936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463299-206f-4c78-abbd-2f12411f5dea None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:49.027033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:49.027845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:49.028132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:49.032560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:49.042598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:49.044313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:46:49.058804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:49.064612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:49.065983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 606/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:49.066804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:49.121585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:49.179745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571237-4dd7-45d2-8318-bc6fb292883f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:49.218102 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:49.218767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:49.219055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:49.219332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:49.220158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:49.220466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:49.221916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:49.243490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 621/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 3 09:46:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:49.250857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:49.356536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd51e32-fd6e-4189-bf05-15b85cc117f8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:49.394522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:49.395323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:49.395620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:49.395935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:49.408425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:49.410273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:49.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:49.430661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:49.431813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:49.431813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:49.431813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:49.431813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:49.431813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 607/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:49.436553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:49.545171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86314-6c56-4ae4-be27-bb91caae7125 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:49.547623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:49.583977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:49.585572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:49.585572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:49.585572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:49.585941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:49.586254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:49.587620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:49.600577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 622/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:49.606364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:49.617338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:49.719024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a009a0-1bf9-4ebf-a5be-8681fa732ce4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:49.757255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:49.758205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:49.758493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:49.758774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:49.766362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:49.767989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:46:49.783904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:49.784914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:49.786337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 608/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:49.791151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:49.900406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad785c-5d5c-498d-88f9-bfbf191b15b6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:49.937022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f8cb0-b7fc-4c83-b2e6-e8ac4b6fbfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:49.937678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8cb0-b7fc-4c83-b2e6-e8ac4b6fbfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:49.937991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8cb0-b7fc-4c83-b2e6-e8ac4b6fbfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:49.938267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8cb0-b7fc-4c83-b2e6-e8ac4b6fbfe0 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:49.939039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f8cb0-b7fc-4c83-b2e6-e8ac4b6fbfe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:49.939347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f8cb0-b7fc-4c83-b2e6-e8ac4b6fbfe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:49.940994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f8cb0-b7fc-4c83-b2e6-e8ac4b6fbfe0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:49.955206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 623/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:49.961236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:50.030950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:50.065474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66e60a-33cb-4b54-8ea1-7b21c4006278 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:50.103677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702641c-b318-4a8d-8c80-3ab560d40857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:50.104722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702641c-b318-4a8d-8c80-3ab560d40857 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:50.105060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702641c-b318-4a8d-8c80-3ab560d40857 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:50.105347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702641c-b318-4a8d-8c80-3ab560d40857 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/33c559aafd5f4ebdbc3bb654926d2c5c/roles/3a6e3fdefefd4f8396998db7f4c9a9c5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:50.121710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702641c-b318-4a8d-8c80-3ab560d40857 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=33c559aafd5f4ebdbc3bb654926d2c5c, role_id=3a6e3fdefefd4f8396998db7f4c9a9c5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:50.123430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702641c-b318-4a8d-8c80-3ab560d40857 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:50.137017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 609/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:46:49 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/33c559aafd5f4ebdbc3bb654926d2c5c/roles/3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:46:52.435167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b91af-52c9-4b05-b6e4-04c929ffe101 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:52.435724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b91af-52c9-4b05-b6e4-04c929ffe101 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:52.435832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b91af-52c9-4b05-b6e4-04c929ffe101 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:52.437146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 624/1233] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:46:52.443132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c05b6-886a-44ef-bd55-bbca9e41fd85 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:52.443644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c05b6-886a-44ef-bd55-bbca9e41fd85 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:52.443748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c05b6-886a-44ef-bd55-bbca9e41fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:52.461516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dd8c05b6-886a-44ef-bd55-bbca9e41fd85 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:46:52.462911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dd8c05b6-886a-44ef-bd55-bbca9e41fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:46:52.536050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 610/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:46:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:46:52.563004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b91af-52c9-4b05-b6e4-04c929ffe101 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:52.594851 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:52.684617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b91af-52c9-4b05-b6e4-04c929ffe101 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:52.723938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:52.724750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:52.725036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:52.725309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:52.738994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:46:52.751658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:52.752676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:52.753537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 625/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Jun 3 09:46:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:52.759750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c05b6-886a-44ef-bd55-bbca9e41fd85 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:52.819914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:52.882633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c05b6-886a-44ef-bd55-bbca9e41fd85 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:52.920668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:52.921343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:52.921635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:52.921960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:52.922711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:52.923021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:52.924406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:52.933818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 611/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Jun 3 09:46:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:52.940160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:53.033738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:53.049874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40322c7-df61-4e60-ab3e-5dc08bb5b1fe None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:53.085239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:53.086061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:53.086345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:53.086667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:53.098160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:53.099669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:53.118560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:53.119704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:53.120657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:53.120657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:53.120657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:53.120657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:53.120657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 626/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:53.125655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:53.252428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178704-e6b9-4abd-99ae-4799fa205dc9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:53.262510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:53.291967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:53.292654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:53.292943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:53.293223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:53.294021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:53.294327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:53.296069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:53.310730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 612/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:53.316736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:53.431671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c254-bc62-43f5-98ab-627003de6420 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:53.470795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:53.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:53.471889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:53.472163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:53.475087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:53.481496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:53.483248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:46:53.500002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:53.501443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:53.502692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:53.506752 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 627/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:53.508016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:53.615579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf140de-840e-4e8a-8e91-73b4eee0494c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:53.652042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:53.652716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:53.653000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:53.653277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:53.654230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:53.654543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:53.656045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:53.674608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 613/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 3 09:46:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:53.681051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:53.789873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b25a-9e70-4347-b89a-3ea21ec34b6b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:53.830295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:53.831040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:53.831398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:53.831754 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:53.901999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:53.909654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:53.911184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:54.023248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 628/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:46:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:46:54.029596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:54.060046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:54.144318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa098a1a-f5f8-41af-9d0e-7353340fae27 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:54.184330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:54.185112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:54.185288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:54.185538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:54.200210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:54.201714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:54.219484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:54.221180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:54.222443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:54.222443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:54.222443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:54.222443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:54.222443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 614/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:54.226504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:54.327241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:54.335228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c01b2-eb41-454d-8372-0ab35adaf98b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:54.378492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:54.379570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:54.380019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:54.380299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:54.381063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:54.381380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:54.382812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:54.396089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 629/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:54.402926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:54.497511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:54.520905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226211fb-066e-4af9-b96a-48ae87f9632c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:54.559267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:54.560061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:54.560350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:54.560629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:54.568058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:54.569524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:46:54.583913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:54.584947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:54.585971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 615/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:46:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:54.592890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:54.707141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81657-de6a-4906-aa8b-86ab4118a131 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:54.749246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eeec2-e4e4-48f1-bf25-6261c9e4bbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:54.750037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eeec2-e4e4-48f1-bf25-6261c9e4bbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:54.750360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eeec2-e4e4-48f1-bf25-6261c9e4bbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:54.750847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eeec2-e4e4-48f1-bf25-6261c9e4bbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:54.751822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eeec2-e4e4-48f1-bf25-6261c9e4bbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:54.752138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eeec2-e4e4-48f1-bf25-6261c9e4bbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:54.754019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eeec2-e4e4-48f1-bf25-6261c9e4bbd7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:54.772908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 630/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:54.779813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:54.896613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ad643-fb7b-4586-838b-969e438e15ef None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:54.933209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba1b79-fc03-4653-a3ad-146ee4af9bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:54.934016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba1b79-fc03-4653-a3ad-146ee4af9bde None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:54.934348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba1b79-fc03-4653-a3ad-146ee4af9bde None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:54.934632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba1b79-fc03-4653-a3ad-146ee4af9bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:54.935594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba1b79-fc03-4653-a3ad-146ee4af9bde None admin] RBAC: Adding query filter params (role.id=3a6e3fdefefd4f8396998db7f4c9a9c5, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=33c559aafd5f4ebdbc3bb654926d2c5c) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:54.935993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba1b79-fc03-4653-a3ad-146ee4af9bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:54.937626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba1b79-fc03-4653-a3ad-146ee4af9bde None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:54.943833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 616/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:46:54 2022] GET /identity/v3/role_assignments?user.id=33c559aafd5f4ebdbc3bb654926d2c5c&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=3a6e3fdefefd4f8396998db7f4c9a9c5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:46:57.318755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f53a0-7650-4da6-92fc-931ebd25f2cf None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:57.319317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f53a0-7650-4da6-92fc-931ebd25f2cf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:57.319317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f53a0-7650-4da6-92fc-931ebd25f2cf None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:57.320789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 631/1247] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:46:57.326451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00331e-e8c3-4b0c-bec7-ae3954785af9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:57.326907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00331e-e8c3-4b0c-bec7-ae3954785af9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:57.327124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00331e-e8c3-4b0c-bec7-ae3954785af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:57.332728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:57.345835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ff00331e-e8c3-4b0c-bec7-ae3954785af9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:46:57.347047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ff00331e-e8c3-4b0c-bec7-ae3954785af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:46:57.425857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 617/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:46:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:46:57.450648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f53a0-7650-4da6-92fc-931ebd25f2cf None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:57.471383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:57.562864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f53a0-7650-4da6-92fc-931ebd25f2cf None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:57.597035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:57.597811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:57.598065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:57.598347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:57.610831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:46:57.619744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:57.620736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:57.621604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 632/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:57.627140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00331e-e8c3-4b0c-bec7-ae3954785af9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:57.741957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00331e-e8c3-4b0c-bec7-ae3954785af9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:57.777341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:57.783287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:57.783956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:57.784240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:57.784517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:57.785253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:57.785559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:57.787621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:57.796860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 618/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:57.802772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:57.885459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:57.910645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71c11-2471-45a2-9c15-78309e140423 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:57.947996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:57.948795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:57.949084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:57.949367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:57.961184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:57.962693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:57.979729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:57.980811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:57.987020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:57.987020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:57.987020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:57.987020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:57.987020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 633/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:57.987523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:58.097060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4896-26f7-4ccd-b754-aa67b418c5c3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:58.134016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:58.134678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:58.134963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:58.135239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:58.136007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:58.136269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:58.137807 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:58.150246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 619/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:58.156305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:58.280534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4fccc-9263-45b6-8e29-cfd7bf64e6f7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:58.309719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:58.318602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:58.319404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:58.319934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:58.319934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:58.327670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:58.329122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:46:58.343311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:58.344409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:46:58.351114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 634/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:58.351725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:58.413199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:58.459683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173480-5589-48bc-bfe8-1abe79b8804c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:58.495034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:58.495702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:58.495989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:58.496268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:58.497100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:58.497413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:58.500158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:58.518714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 620/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 3 09:46:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:58.525420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:58.641844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8238f-09c4-4298-9481-f41d21a78df8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:58.679667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:58.680339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:58.680620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:58.680900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:58.753759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:58.771476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:58.773333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:58.882887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 635/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:46:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:46:58.888894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:58.992021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b249e0-2d5c-4dc8-8998-d5fe14ee6a55 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:59.006714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:59.029328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:59.030224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:59.030514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:59.030794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:59.041303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:59.042793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:46:59.060799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:59.061974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:59.063326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:46:59.063326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:46:59.063326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:46:59.063326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:59.063326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 621/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:59.068403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:59.160615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:59.177543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419d0e6-38bf-4bba-9558-200f64849f76 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:59.215501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:59.216229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:59.216545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:59.216898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:59.217612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:59.217959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:59.219436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:59.233317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 636/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:59.239064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:59.340666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37475cf-73a1-4907-b91e-78c959e4c4a3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:59.374026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:59.374826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:59.375109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:59.375825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:59.389015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:59.390865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:46:59.405426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:46:59.406466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:46:59.407352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 622/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:46:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:46:59.412660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:59.514453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b3d1-febd-4572-ab9d-9bf97db2f17b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:59.547258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3f93-f124-42b4-8022-d5f171546ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:59.547918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3f93-f124-42b4-8022-d5f171546ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:59.548207 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3f93-f124-42b4-8022-d5f171546ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:59.548491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3f93-f124-42b4-8022-d5f171546ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:59.549274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3f93-f124-42b4-8022-d5f171546ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:59.549586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3f93-f124-42b4-8022-d5f171546ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:59.551064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3f93-f124-42b4-8022-d5f171546ea8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:59.563810 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 637/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:46:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:46:59.570493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:46:59.595834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:46:59.668273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ade5-7f9a-4516-997e-f71ce4654d66 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:46:59.700441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cb21b-51a3-4a0b-b21a-d3d2d048955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:46:59.701084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb21b-51a3-4a0b-b21a-d3d2d048955f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:46:59.701376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb21b-51a3-4a0b-b21a-d3d2d048955f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:46:59.701657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb21b-51a3-4a0b-b21a-d3d2d048955f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:46:59.702518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb21b-51a3-4a0b-b21a-d3d2d048955f None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=33c559aafd5f4ebdbc3bb654926d2c5c) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:46:59.702838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb21b-51a3-4a0b-b21a-d3d2d048955f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:46:59.704275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb21b-51a3-4a0b-b21a-d3d2d048955f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:46:59.709590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 623/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:46:59 2022] GET /identity/v3/role_assignments?user.id=33c559aafd5f4ebdbc3bb654926d2c5c&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=296e3902a56444e692e58d5eb525a587 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:01.913659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691424-5bd0-407a-873d-8bdcf8e44c47 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:01.914223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691424-5bd0-407a-873d-8bdcf8e44c47 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:01.914316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691424-5bd0-407a-873d-8bdcf8e44c47 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:01.915618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 638/1261] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:47:01.920702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30d29-9b81-4047-bd18-ba9a66cc5b1a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:01.921103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30d29-9b81-4047-bd18-ba9a66cc5b1a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:01.921271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30d29-9b81-4047-bd18-ba9a66cc5b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:01.938205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8ff30d29-9b81-4047-bd18-ba9a66cc5b1a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:47:01.939387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8ff30d29-9b81-4047-bd18-ba9a66cc5b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:47:02.003320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 624/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:47:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:47:02.025611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691424-5bd0-407a-873d-8bdcf8e44c47 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:02.036770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:02.123261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691424-5bd0-407a-873d-8bdcf8e44c47 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:02.155897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:02.156674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:02.156981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:02.157309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:02.168582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:47:02.177563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:02.178740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:47:02.179736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 639/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:47:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:02.185008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30d29-9b81-4047-bd18-ba9a66cc5b1a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:02.204451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:02.289917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30d29-9b81-4047-bd18-ba9a66cc5b1a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:02.322716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:02.323332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:02.323619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:02.323896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:02.324634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:02.324930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:02.326325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:02.334169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 625/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:47:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:02.339982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:02.404640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:02.437655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f346d-d05f-43e6-8f40-b366165be54a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:02.470520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:02.471301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:02.471589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:02.471868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:02.482163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:02.483625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:47:02.500706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:02.501689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:02.502795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:47:02.502795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:47:02.502795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:02.502795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:47:02.502795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 640/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:02.508125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:02.586311 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:02.605411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276845-9bdf-4aed-bbfd-753281d3260a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:02.637268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:02.637946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:02.638235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:02.638514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:02.639222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:02.639527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:02.640893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:02.652383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 626/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:02.657820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:02.760380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fa128-a15f-4112-8332-5c666f67917f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:02.779228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:02.793247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:02.794065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:02.794349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:02.794624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:02.802387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:02.803830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:47:02.825395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:02.826575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:47:02.827750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 641/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:47:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 09:47:02.832356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:02.927993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ddd0e-1bb9-4806-9855-b7df64bd328a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:02.960321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:02.960973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:02.961258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:02.961537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:02.962390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:02.962701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:02.964128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:02.972326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:02.981875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 627/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 3 09:47:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:02.987320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:03.084416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db3b4f-fb95-4717-9608-24e3f827c7f8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:03.116473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:03.117240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:03.117526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:03.117844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:03.128013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:03.129463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:47:03.146820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:03.147906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:03.149194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:47:03.149194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:47:03.149194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:03.149194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:47:03.149194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 642/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:03.154323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:03.259380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d86f33-a868-4767-8c14-93f7f89ebd28 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:03.292529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:03.293177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:03.293462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:03.293740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:03.294480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:03.294787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:03.296149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:03.306949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 628/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:03.312620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:03.344566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:03.415463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b91bc-01c4-4042-86ff-f475d5ff520e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:03.447700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:03.448474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:03.448762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:03.449038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:03.455427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:03.456870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:47:03.470574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:03.471604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:47:03.472783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 643/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:03.477987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:03.535847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:03.576810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629068e9-602e-4b2c-956f-d2b003d267d2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:03.608899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed303d-6b0f-460f-b512-5ed19dd5b0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:03.609494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed303d-6b0f-460f-b512-5ed19dd5b0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:03.609808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed303d-6b0f-460f-b512-5ed19dd5b0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:03.610094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed303d-6b0f-460f-b512-5ed19dd5b0f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:03.610867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed303d-6b0f-460f-b512-5ed19dd5b0f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:03.611179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed303d-6b0f-460f-b512-5ed19dd5b0f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:03.612607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed303d-6b0f-460f-b512-5ed19dd5b0f7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:03.624926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 629/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:03.630698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:03.718619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:03.728138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b28f18-8936-4d63-ba6f-a03c6387d7f5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:03.760014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48a514-fab8-46f3-b520-f151093c63d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:03.760879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48a514-fab8-46f3-b520-f151093c63d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:03.761158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48a514-fab8-46f3-b520-f151093c63d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:03.761430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48a514-fab8-46f3-b520-f151093c63d8 None admin] PATH_INFO: `/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/33c559aafd5f4ebdbc3bb654926d2c5c/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:03.763355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48a514-fab8-46f3-b520-f151093c63d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc79d0d649b647a8b7b78b29ac8ca319, user_id=33c559aafd5f4ebdbc3bb654926d2c5c, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:03.764765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48a514-fab8-46f3-b520-f151093c63d8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:03.777438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 644/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Jun 3 09:47:03 2022] PUT /identity/v3/projects/cc79d0d649b647a8b7b78b29ac8ca319/users/33c559aafd5f4ebdbc3bb654926d2c5c/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:47:05.990404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408331-8e4d-438d-8d47-3c12b0e56ffe None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:05.990954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408331-8e4d-438d-8d47-3c12b0e56ffe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:05.990954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408331-8e4d-438d-8d47-3c12b0e56ffe None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:05.992329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 630/1274] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:47:05.997524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25240-33fd-4287-9969-d3d447a02518 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:05.997931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25240-33fd-4287-9969-d3d447a02518 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:05.998115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25240-33fd-4287-9969-d3d447a02518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:06.015149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-96c25240-33fd-4287-9969-d3d447a02518 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:47:06.016314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-96c25240-33fd-4287-9969-d3d447a02518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:47:06.080623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 645/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:47:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:47:06.103521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74408331-8e4d-438d-8d47-3c12b0e56ffe None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:06.211301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74408331-8e4d-438d-8d47-3c12b0e56ffe None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:06.235221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:06.252094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:06.252824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:06.253110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:06.253390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:06.263855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 09:47:06.271412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:06.272495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:06.273391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 631/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Jun 3 09:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:06.278856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25240-33fd-4287-9969-d3d447a02518 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:06.356957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:06.376113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25240-33fd-4287-9969-d3d447a02518 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:06.409090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:06.409773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:06.410063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:06.410344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:06.411612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:06.411921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:06.413278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:06.421101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 646/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Jun 3 09:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:06.427392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:06.524614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e8a2-7896-4172-b79a-b0c4c9655e4e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:06.557867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:06.558643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:06.558931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:06.559209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:06.569288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:06.570777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:47:06.587132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:06.588179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:06.592925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:47:06.592925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:47:06.592925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:06.592925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:06.592925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 632/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:06.594340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:06.690289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423005b-4dee-426c-a249-d6f0bfb694fa None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:06.722284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:06.722926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:06.723215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:06.723517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:06.724750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:06.725057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:06.726430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:06.737574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 647/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:06.743380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:06.776406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:06.844167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8c00-1721-403c-a70a-a9c38b072ce3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:06.879461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:06.880295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:06.880581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:06.880862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:06.888102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:06.889543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 09:47:06.904074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:06.905157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:06.906184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 633/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:47:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:06.911802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:06.915574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:07.010065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60afb8-2110-4fd6-988d-8f61c7bc18d8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:07.043700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:07.044299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:07.044589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:07.044869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:07.045697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:07.046039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:07.047474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:07.063777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 648/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Jun 3 09:47:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:07.069396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:07.157604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:07.169050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea787-075e-4ae0-a532-eb1f2299bb2b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:07.202142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:07.202786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:07.203075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:07.203359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:07.268659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:07.270149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:07.354677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:07.364904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 634/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Jun 3 09:47:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 09:47:07.370656 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:07.430737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:07.468609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f2e79-a7d5-4063-b554-2aa19e8724a2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:07.501269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:07.502082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:07.502371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:07.502653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:07.512908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:07.514392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 09:47:07.532481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:07.533593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:07.534591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 09:47:07.534591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 09:47:07.534591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 09:47:07.534591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:47:07.534591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 649/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:07.539351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:07.635462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cdb5c-5216-4b66-be02-ca42396996d3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:07.667131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:07.667777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:07.668061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:07.668335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:07.669034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:07.669336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:07.670741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:07.681891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 635/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Jun 3 09:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:07.687519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:07.783999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c4469-0357-4526-bed3-da3bca0e353a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:07.797991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:07.817528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:07.818332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:07.818642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:07.818922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:07.825411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:07.826890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 09:47:07.840738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:07.841769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: ERROR keystone.server.flask.application Jun 03 09:47:07.842878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 650/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Jun 3 09:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:07.847584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:07.896006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:07.943279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdfdf1-1cae-42d9-9362-3ac4b5472187 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:07.974683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d02f31-e9df-453a-a563-097b4503b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:07.975317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d02f31-e9df-453a-a563-097b4503b974 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:07.975597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d02f31-e9df-453a-a563-097b4503b974 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:07.975873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d02f31-e9df-453a-a563-097b4503b974 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:07.976632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d02f31-e9df-453a-a563-097b4503b974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:07.976935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d02f31-e9df-453a-a563-097b4503b974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:07.978378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d02f31-e9df-453a-a563-097b4503b974 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:07.989620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 636/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Jun 3 09:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:07.995521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:08.093241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34166dd8-4f19-4810-941b-89f6588ab570 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:08.125044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5554c-3574-42e5-afe9-7e7d8638a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:08.125674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5554c-3574-42e5-afe9-7e7d8638a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:08.125983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5554c-3574-42e5-afe9-7e7d8638a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:08.126260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5554c-3574-42e5-afe9-7e7d8638a5ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:08.127071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5554c-3574-42e5-afe9-7e7d8638a5ca None admin] RBAC: Adding query filter params (role.id=296e3902a56444e692e58d5eb525a587, scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319, user.id=33c559aafd5f4ebdbc3bb654926d2c5c) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:08.127380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5554c-3574-42e5-afe9-7e7d8638a5ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:08.128786 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5554c-3574-42e5-afe9-7e7d8638a5ca None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:08.134964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 651/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Jun 3 09:47:07 2022] GET /identity/v3/role_assignments?user.id=33c559aafd5f4ebdbc3bb654926d2c5c&scope.project.id=cc79d0d649b647a8b7b78b29ac8ca319&role.id=296e3902a56444e692e58d5eb525a587 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:10.379112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc3465-b7d0-4977-88c9-d1d88080222b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:10.379625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc3465-b7d0-4977-88c9-d1d88080222b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:10.380233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc3465-b7d0-4977-88c9-d1d88080222b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:10.381544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 637/1288] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:47:10.386849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4916c2-835e-4ffc-8d8f-472a284a9aa4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:10.387267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4916c2-835e-4ffc-8d8f-472a284a9aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:10.387420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4916c2-835e-4ffc-8d8f-472a284a9aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:10.404749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7f4916c2-835e-4ffc-8d8f-472a284a9aa4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:47:10.405969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7f4916c2-835e-4ffc-8d8f-472a284a9aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:47:10.434312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:10.471214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 652/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:47:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:47:10.494001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc3465-b7d0-4977-88c9-d1d88080222b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:10.592283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc3465-b7d0-4977-88c9-d1d88080222b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:10.603037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:10.628431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:10.629264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:10.629502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:10.629809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:10.630453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:10.631827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:10.643306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:10.649863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:10.651176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 638/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:47:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:10.652181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4916c2-835e-4ffc-8d8f-472a284a9aa4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:10.747250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4916c2-835e-4ffc-8d8f-472a284a9aa4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:10.779910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517399c-3a9d-4df2-93f8-1ed2649dd718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:10.780558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517399c-3a9d-4df2-93f8-1ed2649dd718 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:10.780842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517399c-3a9d-4df2-93f8-1ed2649dd718 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:10.781117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517399c-3a9d-4df2-93f8-1ed2649dd718 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:10.781836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517399c-3a9d-4df2-93f8-1ed2649dd718 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:10.782144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517399c-3a9d-4df2-93f8-1ed2649dd718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:10.783516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517399c-3a9d-4df2-93f8-1ed2649dd718 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:10.788755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 653/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 3 09:47:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:10.794351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:10.890050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff24b28-9caa-4872-95ed-003ac9dd25b1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:10.922936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da14a-dc2d-4a18-818e-d0711ed21e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:10.923592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da14a-dc2d-4a18-818e-d0711ed21e10 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:10.923877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da14a-dc2d-4a18-818e-d0711ed21e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:10.924156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da14a-dc2d-4a18-818e-d0711ed21e10 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:10.924855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8da14a-dc2d-4a18-818e-d0711ed21e10 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:10.925162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8da14a-dc2d-4a18-818e-d0711ed21e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:10.926602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8da14a-dc2d-4a18-818e-d0711ed21e10 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:10.931492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 639/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 3 09:47:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:13.168468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59b00b-e48d-4ab0-9365-1d9080544056 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:13.169238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59b00b-e48d-4ab0-9365-1d9080544056 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:13.169238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59b00b-e48d-4ab0-9365-1d9080544056 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:13.170874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 654/1293] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:47:13.178406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d612-d363-420d-a438-7ec9b8c5832b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:13.178919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d612-d363-420d-a438-7ec9b8c5832b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:13.179347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d612-d363-420d-a438-7ec9b8c5832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:13.198936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2a33d612-d363-420d-a438-7ec9b8c5832b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:47:13.200430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2a33d612-d363-420d-a438-7ec9b8c5832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:47:13.233715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:13.270040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 640/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:47:13.293351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59b00b-e48d-4ab0-9365-1d9080544056 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:13.323872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:13.392270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59b00b-e48d-4ab0-9365-1d9080544056 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:13.425958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21d79-fdb1-4142-a2d6-4ef7fb948907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:13.426601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21d79-fdb1-4142-a2d6-4ef7fb948907 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:13.427380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21d79-fdb1-4142-a2d6-4ef7fb948907 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:13.427657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21d79-fdb1-4142-a2d6-4ef7fb948907 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:13.428379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21d79-fdb1-4142-a2d6-4ef7fb948907 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:13.429734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21d79-fdb1-4142-a2d6-4ef7fb948907 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:13.442260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 655/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Jun 3 09:47:13 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:47:15.664891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52023ae5-6cea-44c9-815a-f287efd0de6a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:15.665387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52023ae5-6cea-44c9-815a-f287efd0de6a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:15.665387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52023ae5-6cea-44c9-815a-f287efd0de6a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:15.666802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 641/1296] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:47:15.672015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88273c1-dfc5-46c5-9efd-df8568f16196 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:15.672449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88273c1-dfc5-46c5-9efd-df8568f16196 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:15.672583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88273c1-dfc5-46c5-9efd-df8568f16196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:15.689488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f88273c1-dfc5-46c5-9efd-df8568f16196 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:47:15.690708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f88273c1-dfc5-46c5-9efd-df8568f16196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:47:15.760629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 656/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:47:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 09:47:15.783326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52023ae5-6cea-44c9-815a-f287efd0de6a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:15.880779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52023ae5-6cea-44c9-815a-f287efd0de6a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:15.914026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:15.914802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:15.915138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:15.915369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:15.916008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:15.917366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:15.929278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:15.930498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:15.931558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 642/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:47:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:15.936334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88273c1-dfc5-46c5-9efd-df8568f16196 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:15.954722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:16.040513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88273c1-dfc5-46c5-9efd-df8568f16196 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:16.072605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:16.073255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:16.073542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:16.073847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:16.074550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:16.074855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:16.076212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:16.081203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 657/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 3 09:47:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:47:16.087640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:16.118031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:16.185128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df9eb-b586-4a03-bf08-6ab107d46341 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:16.217399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d700b2-bbda-403f-8aca-1dee5e1a5757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:16.218075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d700b2-bbda-403f-8aca-1dee5e1a5757 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:16.218364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d700b2-bbda-403f-8aca-1dee5e1a5757 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:16.218644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d700b2-bbda-403f-8aca-1dee5e1a5757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:16.219421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d700b2-bbda-403f-8aca-1dee5e1a5757 None admin] RBAC: Adding query filter params (interface=public, service_id=8e07dc13cc294897b5b3676cfee1eaa3, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:16.219734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d700b2-bbda-403f-8aca-1dee5e1a5757 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:16.221097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d700b2-bbda-403f-8aca-1dee5e1a5757 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:16.226509 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 643/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Jun 3 09:47:16 2022] GET /identity/v3/endpoints?service_id=8e07dc13cc294897b5b3676cfee1eaa3&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:16.232012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:16.311815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:16.329848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7f81-36e8-4354-b1ae-1633e953d2b2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:16.362933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22c271-ce98-403c-bbf6-ad2c10861431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:16.363580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22c271-ce98-403c-bbf6-ad2c10861431 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:16.363868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22c271-ce98-403c-bbf6-ad2c10861431 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:16.364203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22c271-ce98-403c-bbf6-ad2c10861431 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:16.364924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22c271-ce98-403c-bbf6-ad2c10861431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:16.366339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22c271-ce98-403c-bbf6-ad2c10861431 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:16.373295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 658/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Jun 3 09:47:16 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:47:18.592638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803bba-7f44-46eb-99bb-8ba55ae3ca55 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:18.593173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803bba-7f44-46eb-99bb-8ba55ae3ca55 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:18.593269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803bba-7f44-46eb-99bb-8ba55ae3ca55 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:18.594610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 644/1302] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:47:18.600374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710fb70-2be6-4b6e-b57e-e1e67063c8c8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:18.600794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710fb70-2be6-4b6e-b57e-e1e67063c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:18.600940 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710fb70-2be6-4b6e-b57e-e1e67063c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:18.617827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0710fb70-2be6-4b6e-b57e-e1e67063c8c8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:47:18.618999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0710fb70-2be6-4b6e-b57e-e1e67063c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:47:18.682804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 659/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:47:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 09:47:18.705695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88803bba-7f44-46eb-99bb-8ba55ae3ca55 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:18.797585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:18.805155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88803bba-7f44-46eb-99bb-8ba55ae3ca55 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:18.837060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:18.837953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:18.838245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:18.838524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:18.839165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:18.840535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 09:47:18.852097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 09:47:18.853267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jun 03 09:47:18.854668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 645/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Jun 3 09:47:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 09:47:18.859290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710fb70-2be6-4b6e-b57e-e1e67063c8c8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:18.939935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:18.962610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710fb70-2be6-4b6e-b57e-e1e67063c8c8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:19.001891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a34ce-3f73-45f3-98c1-770e2980d61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:19.002549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a34ce-3f73-45f3-98c1-770e2980d61f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:19.002837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a34ce-3f73-45f3-98c1-770e2980d61f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:19.003117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a34ce-3f73-45f3-98c1-770e2980d61f None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:19.003818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a34ce-3f73-45f3-98c1-770e2980d61f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:47:19.004125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a34ce-3f73-45f3-98c1-770e2980d61f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:19.005533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a34ce-3f73-45f3-98c1-770e2980d61f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:19.010613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 660/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Jun 3 09:47:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:47:19.016318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:47:19.112753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078caaa-6cb7-43d0-bbb7-3015001bd46e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:47:19.144643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbecdba-3e56-449c-8039-5bf4e7469e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:47:19.145868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbecdba-3e56-449c-8039-5bf4e7469e53 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:47:19.146156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbecdba-3e56-449c-8039-5bf4e7469e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:47:19.146428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbecdba-3e56-449c-8039-5bf4e7469e53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:47:19.147155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbecdba-3e56-449c-8039-5bf4e7469e53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:47:19.148504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbecdba-3e56-449c-8039-5bf4e7469e53 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:47:19.166095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 646/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Jun 3 09:47:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:47:29.007673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=30 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:47:29.161978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:23.434322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbc2d-11cd-4e44-99e8-45e3920c83ba None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:23.434908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbc2d-11cd-4e44-99e8-45e3920c83ba None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:23.434908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbc2d-11cd-4e44-99e8-45e3920c83ba None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:23.440079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 661/1307] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:23.441482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d40dae-a16d-4af3-b5a5-c4dd07c513d1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:23.441958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d40dae-a16d-4af3-b5a5-c4dd07c513d1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:23.442059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d40dae-a16d-4af3-b5a5-c4dd07c513d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:23.528640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d3d40dae-a16d-4af3-b5a5-c4dd07c513d1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:23.530042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d3d40dae-a16d-4af3-b5a5-c4dd07c513d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:23.722361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 647/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:48:23.780790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c064c-5f43-4fb6-9c6e-5c3854c42f6e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:23.781090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c064c-5f43-4fb6-9c6e-5c3854c42f6e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:23.781377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c064c-5f43-4fb6-9c6e-5c3854c42f6e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:23.782836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 662/1309] 10.222.0.45 () {54 vars in 964 bytes} [Fri Jun 3 09:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:23.789427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2730b4-4e1f-4059-b828-970083a5bd2d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:23.789732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2730b4-4e1f-4059-b828-970083a5bd2d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:23.790085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2730b4-4e1f-4059-b828-970083a5bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:24.021446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eb2730b4-4e1f-4059-b828-970083a5bd2d None None] MFA Rules not processed for user `2585af8b95ea48d1a3576bd722536fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:24.022790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eb2730b4-4e1f-4059-b828-970083a5bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:24.051956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:24.117657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 648/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Jun 3 09:48:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:24.126741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c064c-5f43-4fb6-9c6e-5c3854c42f6e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:24.128516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a54c064c-5f43-4fb6-9c6e-5c3854c42f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:24.261971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c064c-5f43-4fb6-9c6e-5c3854c42f6e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:24.346021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f80c87-d970-4be7-9b59-6d7f6b754280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:24.346570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80c87-d970-4be7-9b59-6d7f6b754280 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:24.346849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80c87-d970-4be7-9b59-6d7f6b754280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:24.347122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80c87-d970-4be7-9b59-6d7f6b754280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:24.349627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-35f80c87-d970-4be7-9b59-6d7f6b754280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:24.413906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:24.478295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f80c87-d970-4be7-9b59-6d7f6b754280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:24.480101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f80c87-d970-4be7-9b59-6d7f6b754280 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:24.514980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 663/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:27.137054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e5f4-3837-4958-8046-50fde92a0aff None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:27.137520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e5f4-3837-4958-8046-50fde92a0aff None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:27.137652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e5f4-3837-4958-8046-50fde92a0aff None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:27.139075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 649/1312] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:27.144598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a502ad-184d-4e2a-bbc2-e299a16d463f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:27.145056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a502ad-184d-4e2a-bbc2-e299a16d463f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:27.145173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a502ad-184d-4e2a-bbc2-e299a16d463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:27.235019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c9a502ad-184d-4e2a-bbc2-e299a16d463f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:27.236350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c9a502ad-184d-4e2a-bbc2-e299a16d463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:27.472662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 664/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:27.526742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74523-740b-4dd2-9c27-212623007a0a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:27.527035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74523-740b-4dd2-9c27-212623007a0a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:27.527343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74523-740b-4dd2-9c27-212623007a0a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:27.528759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 650/1314] 10.222.0.45 () {54 vars in 964 bytes} [Fri Jun 3 09:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:27.534855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d274a8a-55e5-45f3-86c7-7c0660224232 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:27.535183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d274a8a-55e5-45f3-86c7-7c0660224232 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:27.535468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d274a8a-55e5-45f3-86c7-7c0660224232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:27.546079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:27.611437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9d274a8a-55e5-45f3-86c7-7c0660224232 None None] MFA Rules not processed for user `2585af8b95ea48d1a3576bd722536fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:27.612646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9d274a8a-55e5-45f3-86c7-7c0660224232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:27.688688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 665/1315] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Jun 3 09:48:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:27.698385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f74523-740b-4dd2-9c27-212623007a0a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:27.699904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c9f74523-740b-4dd2-9c27-212623007a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:27.802320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f74523-740b-4dd2-9c27-212623007a0a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:27.873887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:27.876882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32545c0-e142-485a-a8e3-aadca04f8d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:27.877834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32545c0-e142-485a-a8e3-aadca04f8d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:27.878355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32545c0-e142-485a-a8e3-aadca04f8d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:27.879258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32545c0-e142-485a-a8e3-aadca04f8d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:27.881104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c32545c0-e142-485a-a8e3-aadca04f8d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:27.987332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32545c0-e142-485a-a8e3-aadca04f8d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:27.989306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32545c0-e142-485a-a8e3-aadca04f8d14 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:28.007660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 651/1316] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:30.788948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc696-b617-42bc-b01b-0c9a9a04b590 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:30.789479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc696-b617-42bc-b01b-0c9a9a04b590 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:30.789575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc696-b617-42bc-b01b-0c9a9a04b590 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:30.790907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 666/1317] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:30.796169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687848ef-28a8-4fcb-adc0-815e75e03710 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:30.796591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687848ef-28a8-4fcb-adc0-815e75e03710 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:30.796738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687848ef-28a8-4fcb-adc0-815e75e03710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:30.858813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-687848ef-28a8-4fcb-adc0-815e75e03710 None None] MFA Rules not processed for user `e1cd5a9e0bd44d41a453c971e87604ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:30.860005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-687848ef-28a8-4fcb-adc0-815e75e03710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:30.911068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:30.954199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 652/1318] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:30.999112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cc696-b617-42bc-b01b-0c9a9a04b590 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:31.000627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3e7cc696-b617-42bc-b01b-0c9a9a04b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:31.114462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cc696-b617-42bc-b01b-0c9a9a04b590 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:31.117341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:31.198691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d529-199f-418b-b8b3-ba93b801d5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:31.199342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d529-199f-418b-b8b3-ba93b801d5de service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:31.199628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d529-199f-418b-b8b3-ba93b801d5de service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:31.199904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d529-199f-418b-b8b3-ba93b801d5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:31.201544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c0c1d529-199f-418b-b8b3-ba93b801d5de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:31.322904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1d529-199f-418b-b8b3-ba93b801d5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:31.324443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1d529-199f-418b-b8b3-ba93b801d5de service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:31.345483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 667/1319] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:34.329034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54522-1dbc-4ff0-93ba-30fee764fd00 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:34.329601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54522-1dbc-4ff0-93ba-30fee764fd00 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:34.329601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54522-1dbc-4ff0-93ba-30fee764fd00 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:34.331022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 653/1320] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:34.336795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ede8b7-07f3-42e4-9eaf-1d337f295b5e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:34.337199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ede8b7-07f3-42e4-9eaf-1d337f295b5e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:34.337367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ede8b7-07f3-42e4-9eaf-1d337f295b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:34.375445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:34.402698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-15ede8b7-07f3-42e4-9eaf-1d337f295b5e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:34.403895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-15ede8b7-07f3-42e4-9eaf-1d337f295b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:34.497515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 668/1321] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:34.536470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54522-1dbc-4ff0-93ba-30fee764fd00 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:34.538017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e0a54522-1dbc-4ff0-93ba-30fee764fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:34.639241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54522-1dbc-4ff0-93ba-30fee764fd00 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:34.709949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404049b-7488-4097-82de-c01993c255c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:34.710590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404049b-7488-4097-82de-c01993c255c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:34.710874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404049b-7488-4097-82de-c01993c255c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:34.711150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404049b-7488-4097-82de-c01993c255c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:34.712781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2404049b-7488-4097-82de-c01993c255c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:34.720014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:34.819248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404049b-7488-4097-82de-c01993c255c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:34.820687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404049b-7488-4097-82de-c01993c255c6 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:34.838259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 654/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:37.795450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568ec2-41e6-4007-8c0c-3bc39336fc3f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:37.795975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568ec2-41e6-4007-8c0c-3bc39336fc3f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:37.796097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568ec2-41e6-4007-8c0c-3bc39336fc3f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:37.797555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 669/1323] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:37.803160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483faf8b-1ea6-4aaa-999c-4e97231807e9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:37.803604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483faf8b-1ea6-4aaa-999c-4e97231807e9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:37.803751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483faf8b-1ea6-4aaa-999c-4e97231807e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:37.868433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-483faf8b-1ea6-4aaa-999c-4e97231807e9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:37.869617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-483faf8b-1ea6-4aaa-999c-4e97231807e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:37.925045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:37.963462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 655/1324] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:38.000022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568ec2-41e6-4007-8c0c-3bc39336fc3f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:38.001518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e7568ec2-41e6-4007-8c0c-3bc39336fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:38.103971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568ec2-41e6-4007-8c0c-3bc39336fc3f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:38.117183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:38.182430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdae59-a7dc-48df-9a00-3aae5685e40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:38.183082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdae59-a7dc-48df-9a00-3aae5685e40c service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:38.183366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdae59-a7dc-48df-9a00-3aae5685e40c service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:38.183646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdae59-a7dc-48df-9a00-3aae5685e40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:38.185274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-17cdae59-a7dc-48df-9a00-3aae5685e40c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:38.296997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdae59-a7dc-48df-9a00-3aae5685e40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:38.298430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdae59-a7dc-48df-9a00-3aae5685e40c service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:38.316744 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 670/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:40.639652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae6f3c-82bb-4157-b23f-750254da8b85 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:40.640216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae6f3c-82bb-4157-b23f-750254da8b85 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:40.640216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae6f3c-82bb-4157-b23f-750254da8b85 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:40.641857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 656/1326] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:40.646896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7991fb-3b6a-4573-856a-059253d52e08 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:40.647327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7991fb-3b6a-4573-856a-059253d52e08 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:40.647449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7991fb-3b6a-4573-856a-059253d52e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:40.694451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:40.712234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fc7991fb-3b6a-4573-856a-059253d52e08 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:40.713417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fc7991fb-3b6a-4573-856a-059253d52e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:40.809068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 671/1327] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:40.845120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae6f3c-82bb-4157-b23f-750254da8b85 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:40.846686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-56ae6f3c-82bb-4157-b23f-750254da8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:40.951426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae6f3c-82bb-4157-b23f-750254da8b85 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:41.023959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b322e-5cf8-4806-9972-f2918f68cbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:41.024607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b322e-5cf8-4806-9972-f2918f68cbea service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:41.024892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b322e-5cf8-4806-9972-f2918f68cbea service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:41.025170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b322e-5cf8-4806-9972-f2918f68cbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:41.027102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-770b322e-5cf8-4806-9972-f2918f68cbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:41.043438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:41.133420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b322e-5cf8-4806-9972-f2918f68cbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:41.134903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b322e-5cf8-4806-9972-f2918f68cbea service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:41.153559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 657/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:43.474061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41930fbd-f3c7-4e2b-ae06-49368aa531f9 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:43.474599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41930fbd-f3c7-4e2b-ae06-49368aa531f9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:43.474695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41930fbd-f3c7-4e2b-ae06-49368aa531f9 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:43.475999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 672/1329] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:43.481308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4a3b-c9da-46dd-8b60-7905ee60d43e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:43.481732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4a3b-c9da-46dd-8b60-7905ee60d43e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:43.481923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4a3b-c9da-46dd-8b60-7905ee60d43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:43.546552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-35cb4a3b-c9da-46dd-8b60-7905ee60d43e None None] MFA Rules not processed for user `e1cd5a9e0bd44d41a453c971e87604ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:43.547762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-35cb4a3b-c9da-46dd-8b60-7905ee60d43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:43.611692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:43.644448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 658/1330] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:43.684369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41930fbd-f3c7-4e2b-ae06-49368aa531f9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:43.685935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-41930fbd-f3c7-4e2b-ae06-49368aa531f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:43.795681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41930fbd-f3c7-4e2b-ae06-49368aa531f9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:43.815961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:43.871233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b095c-4ad0-4a58-96bd-7d32bfb1406c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:43.871882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b095c-4ad0-4a58-96bd-7d32bfb1406c service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:43.872165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b095c-4ad0-4a58-96bd-7d32bfb1406c service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:43.872447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b095c-4ad0-4a58-96bd-7d32bfb1406c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:43.874084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-952b095c-4ad0-4a58-96bd-7d32bfb1406c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:43.982447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b095c-4ad0-4a58-96bd-7d32bfb1406c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:43.983900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b095c-4ad0-4a58-96bd-7d32bfb1406c service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:44.001524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 673/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:46.504275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036ba24-0bf4-4e71-a4d7-6387d07b2df5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:46.504715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036ba24-0bf4-4e71-a4d7-6387d07b2df5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:46.504888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036ba24-0bf4-4e71-a4d7-6387d07b2df5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:46.506298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 659/1332] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:46.517301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6bad3-7b02-470f-87ab-d6662e7007c4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:46.517301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6bad3-7b02-470f-87ab-d6662e7007c4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:46.517301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6bad3-7b02-470f-87ab-d6662e7007c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:46.592596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:46.596235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d4b6bad3-7b02-470f-87ab-d6662e7007c4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:46.598640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d4b6bad3-7b02-470f-87ab-d6662e7007c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:46.700429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 674/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:48:46.735673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036ba24-0bf4-4e71-a4d7-6387d07b2df5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:46.737182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e036ba24-0bf4-4e71-a4d7-6387d07b2df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:46.838847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036ba24-0bf4-4e71-a4d7-6387d07b2df5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:46.912360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0771a-33be-4eb3-8043-7d37cab655d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:46.912940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0771a-33be-4eb3-8043-7d37cab655d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:46.913227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0771a-33be-4eb3-8043-7d37cab655d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:46.913505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0771a-33be-4eb3-8043-7d37cab655d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:46.915178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d1a0771a-33be-4eb3-8043-7d37cab655d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:46.941871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:47.023291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0771a-33be-4eb3-8043-7d37cab655d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:47.024738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0771a-33be-4eb3-8043-7d37cab655d8 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:47.042728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 660/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:48:49.339588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37946db-32b4-44cb-97b3-0a60506b6c45 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:49.340154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37946db-32b4-44cb-97b3-0a60506b6c45 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:49.340154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37946db-32b4-44cb-97b3-0a60506b6c45 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:49.341514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 675/1335] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:49.346819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536edf77-4546-4ed7-b014-a5e160ad89a4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:49.347759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536edf77-4546-4ed7-b014-a5e160ad89a4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:49.347927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536edf77-4546-4ed7-b014-a5e160ad89a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:49.411326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-536edf77-4546-4ed7-b014-a5e160ad89a4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:49.412521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-536edf77-4546-4ed7-b014-a5e160ad89a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:49.483622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:49.506529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 661/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:49.545454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37946db-32b4-44cb-97b3-0a60506b6c45 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:49.547058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d37946db-32b4-44cb-97b3-0a60506b6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:49.649083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37946db-32b4-44cb-97b3-0a60506b6c45 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:49.677292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:49.723526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e66a-6c13-41a4-b112-76d48e4bbbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:49.724174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e66a-6c13-41a4-b112-76d48e4bbbfc service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:49.724456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e66a-6c13-41a4-b112-76d48e4bbbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:49.724727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e66a-6c13-41a4-b112-76d48e4bbbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:49.726524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ab18e66a-6c13-41a4-b112-76d48e4bbbfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:49.842700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e66a-6c13-41a4-b112-76d48e4bbbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:49.844144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e66a-6c13-41a4-b112-76d48e4bbbfc service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:49.862480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 676/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:52.409236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9753dbd-d060-41f5-9d8e-5b3292ff0130 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:52.410240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9753dbd-d060-41f5-9d8e-5b3292ff0130 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:52.410372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9753dbd-d060-41f5-9d8e-5b3292ff0130 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:52.411703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 662/1338] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:52.416816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d6d8-4a4e-4ac3-8e31-6e218826bcdd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:52.417260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d6d8-4a4e-4ac3-8e31-6e218826bcdd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:52.417369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d6d8-4a4e-4ac3-8e31-6e218826bcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:52.481040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2213d6d8-4a4e-4ac3-8e31-6e218826bcdd None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:52.482273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2213d6d8-4a4e-4ac3-8e31-6e218826bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:52.490882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:52.578988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 677/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:52.615692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9753dbd-d060-41f5-9d8e-5b3292ff0130 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:52.617271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b9753dbd-d060-41f5-9d8e-5b3292ff0130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:52.723128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9753dbd-d060-41f5-9d8e-5b3292ff0130 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:52.794682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5741d2d-d0ca-4cd8-84ea-fa56606426ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:52.795325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5741d2d-d0ca-4cd8-84ea-fa56606426ab service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:52.795610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5741d2d-d0ca-4cd8-84ea-fa56606426ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:52.795886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5741d2d-d0ca-4cd8-84ea-fa56606426ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:52.797510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d5741d2d-d0ca-4cd8-84ea-fa56606426ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:52.831670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:52.904034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5741d2d-d0ca-4cd8-84ea-fa56606426ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:52.905465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5741d2d-d0ca-4cd8-84ea-fa56606426ab service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:52.922741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 663/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:48:57.137163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85d72-093b-4328-a794-0f77780c9bec None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:57.137689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85d72-093b-4328-a794-0f77780c9bec None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:57.137689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85d72-093b-4328-a794-0f77780c9bec None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:57.139061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 678/1341] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:48:57.144363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772f99-5e2c-4bad-baa9-a5d6c9f126a1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:57.144861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772f99-5e2c-4bad-baa9-a5d6c9f126a1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:57.145087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772f99-5e2c-4bad-baa9-a5d6c9f126a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:57.218800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-85772f99-5e2c-4bad-baa9-a5d6c9f126a1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:48:57.220003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-85772f99-5e2c-4bad-baa9-a5d6c9f126a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:57.313699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:48:57.327662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 664/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:48:57.367358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85d72-093b-4328-a794-0f77780c9bec None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:48:57.369700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-aaf85d72-093b-4328-a794-0f77780c9bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:48:57.466136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85d72-093b-4328-a794-0f77780c9bec None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:48:57.469830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381de714-08b2-4d08-a3d5-aa04c1d76e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:48:57.470420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de714-08b2-4d08-a3d5-aa04c1d76e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:48:57.470701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de714-08b2-4d08-a3d5-aa04c1d76e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:48:57.470977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de714-08b2-4d08-a3d5-aa04c1d76e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:48:57.480480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de714-08b2-4d08-a3d5-aa04c1d76e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:48:57.482087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de714-08b2-4d08-a3d5-aa04c1d76e30 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:48:57.491841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 679/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:00.567682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45edb-9986-4318-8ed8-33caa595f32d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:00.568244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45edb-9986-4318-8ed8-33caa595f32d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:00.568244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45edb-9986-4318-8ed8-33caa595f32d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:00.569632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 665/1344] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:00.574909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debf65a-c6a0-47f3-b3d9-ab23e0184638 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:00.575331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debf65a-c6a0-47f3-b3d9-ab23e0184638 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:00.575508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debf65a-c6a0-47f3-b3d9-ab23e0184638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:00.603123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6debf65a-c6a0-47f3-b3d9-ab23e0184638 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:00.604362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6debf65a-c6a0-47f3-b3d9-ab23e0184638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:00.633927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:00.685627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 680/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:00.723981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac45edb-9986-4318-8ed8-33caa595f32d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:00.734533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac45edb-9986-4318-8ed8-33caa595f32d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:00.738100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f9594-a376-4d4e-babc-fd3fab5cb147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:00.738736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9594-a376-4d4e-babc-fd3fab5cb147 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:00.739023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9594-a376-4d4e-babc-fd3fab5cb147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:00.739302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9594-a376-4d4e-babc-fd3fab5cb147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:00.748217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f9594-a376-4d4e-babc-fd3fab5cb147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:00.749648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f9594-a376-4d4e-babc-fd3fab5cb147 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:00.759929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 666/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:05.178545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755ba0c-6496-4b9d-b544-462e99b5d31b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:05.179050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755ba0c-6496-4b9d-b544-462e99b5d31b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:05.179050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755ba0c-6496-4b9d-b544-462e99b5d31b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:05.180414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 681/1347] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:05.185699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b05ff-9946-4366-8b42-7dde831fa53e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:05.186188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b05ff-9946-4366-8b42-7dde831fa53e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:05.186284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b05ff-9946-4366-8b42-7dde831fa53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:05.203668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0b8b05ff-9946-4366-8b42-7dde831fa53e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:05.204855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0b8b05ff-9946-4366-8b42-7dde831fa53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:05.213107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 667/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:05.251138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755ba0c-6496-4b9d-b544-462e99b5d31b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:05.261992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755ba0c-6496-4b9d-b544-462e99b5d31b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:05.265449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ec391-1372-4a76-aef5-ee646d286cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:05.266112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec391-1372-4a76-aef5-ee646d286cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:05.266402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec391-1372-4a76-aef5-ee646d286cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:05.266679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec391-1372-4a76-aef5-ee646d286cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:05.276183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ec391-1372-4a76-aef5-ee646d286cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:05.277911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ec391-1372-4a76-aef5-ee646d286cd1 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:05.287898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 682/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:10.731506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a619e8-734a-4d64-8fa9-383cc0baae3f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:10.732031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a619e8-734a-4d64-8fa9-383cc0baae3f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:10.732115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a619e8-734a-4d64-8fa9-383cc0baae3f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:10.733423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 668/1350] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 09:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:10.739135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be194415-34bd-4762-8b41-83162a206020 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:10.739901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be194415-34bd-4762-8b41-83162a206020 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:10.740341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be194415-34bd-4762-8b41-83162a206020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:10.820351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-be194415-34bd-4762-8b41-83162a206020 None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:10.821734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-be194415-34bd-4762-8b41-83162a206020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:10.902773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 683/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 09:49:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:49:15.198544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=13 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:15.265591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0273fb-b344-4e7c-8fd5-01e83b37a453 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:15.266409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0273fb-b344-4e7c-8fd5-01e83b37a453 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:15.266970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0273fb-b344-4e7c-8fd5-01e83b37a453 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:15.268725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 669/1352] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 09:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:15.274874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc455d9b-2be2-408f-ba50-8f19deaded12 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:15.275397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc455d9b-2be2-408f-ba50-8f19deaded12 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:15.275491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc455d9b-2be2-408f-ba50-8f19deaded12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:15.295541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bc455d9b-2be2-408f-ba50-8f19deaded12 None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:15.297309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bc455d9b-2be2-408f-ba50-8f19deaded12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:15.307530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 684/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 09:49:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:16.859788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8f38b-7de0-481e-bb14-47da456e6146 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:16.860346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8f38b-7de0-481e-bb14-47da456e6146 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:16.860346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8f38b-7de0-481e-bb14-47da456e6146 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:16.861772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 670/1354] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 09:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:16.866915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf22b0-ed43-406d-8e0f-359d38daa1dd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:16.867330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf22b0-ed43-406d-8e0f-359d38daa1dd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:16.867482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf22b0-ed43-406d-8e0f-359d38daa1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:16.889422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bebf22b0-ed43-406d-8e0f-359d38daa1dd None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:16.890643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bebf22b0-ed43-406d-8e0f-359d38daa1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:16.899736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 685/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 09:49:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:20.639290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d6145-9e35-42b5-80f7-825976e0b374 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:20.640240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d6145-9e35-42b5-80f7-825976e0b374 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:20.640740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d6145-9e35-42b5-80f7-825976e0b374 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:20.642366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 671/1356] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:20.648638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ff2e-1348-4bf2-a216-0b2f6f5000eb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:20.649097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ff2e-1348-4bf2-a216-0b2f6f5000eb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:20.649202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ff2e-1348-4bf2-a216-0b2f6f5000eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:20.667756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ce96ff2e-1348-4bf2-a216-0b2f6f5000eb None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:20.668928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ce96ff2e-1348-4bf2-a216-0b2f6f5000eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:20.681839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 686/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:20.730979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0cb7c-a17c-44d6-b8ae-2aff16a96ceb None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:20.731866 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0cb7c-a17c-44d6-b8ae-2aff16a96ceb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:20.732371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0cb7c-a17c-44d6-b8ae-2aff16a96ceb None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:20.734889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 672/1358] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 3 09:49:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:20.743406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bda8-189f-4d11-a7bb-353b8f3295de None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:20.743704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bda8-189f-4d11-a7bb-353b8f3295de None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:20.743988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bda8-189f-4d11-a7bb-353b8f3295de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:20.794492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:20.805619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0556bda8-189f-4d11-a7bb-353b8f3295de None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:20.806975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0556bda8-189f-4d11-a7bb-353b8f3295de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:20.894845 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 687/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 3 09:49:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:20.903194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0cb7c-a17c-44d6-b8ae-2aff16a96ceb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:20.918363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0cb7c-a17c-44d6-b8ae-2aff16a96ceb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:20.923743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a9353-2321-44b0-8ef2-69cdcef027c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:20.924954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a9353-2321-44b0-8ef2-69cdcef027c0 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:20.925442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a9353-2321-44b0-8ef2-69cdcef027c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:20.925723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a9353-2321-44b0-8ef2-69cdcef027c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:20.934018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a9353-2321-44b0-8ef2-69cdcef027c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:20.935621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a9353-2321-44b0-8ef2-69cdcef027c0 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:20.946560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 673/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:23.428710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804427-c1c3-43d5-8392-a4bc941500b5 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:23.429304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804427-c1c3-43d5-8392-a4bc941500b5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:23.429304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804427-c1c3-43d5-8392-a4bc941500b5 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:23.430838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 688/1361] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:23.435798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462e60-1dd5-4469-8e92-ba7528ba762c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:23.436597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462e60-1dd5-4469-8e92-ba7528ba762c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:23.436886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462e60-1dd5-4469-8e92-ba7528ba762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:23.454911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2e462e60-1dd5-4469-8e92-ba7528ba762c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:23.456759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2e462e60-1dd5-4469-8e92-ba7528ba762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:23.465114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 674/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:23.509808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804427-c1c3-43d5-8392-a4bc941500b5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:23.524506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804427-c1c3-43d5-8392-a4bc941500b5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:23.530260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314347fd-3d86-4a17-bebe-4b964b5fb39a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:23.530910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314347fd-3d86-4a17-bebe-4b964b5fb39a service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:23.531194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314347fd-3d86-4a17-bebe-4b964b5fb39a service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:23.531477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314347fd-3d86-4a17-bebe-4b964b5fb39a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:23.540668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314347fd-3d86-4a17-bebe-4b964b5fb39a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:23.542297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314347fd-3d86-4a17-bebe-4b964b5fb39a service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:23.553240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 689/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:26.141271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a943d1b-4c54-4816-8765-2b15f0ac1727 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:26.141801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a943d1b-4c54-4816-8765-2b15f0ac1727 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:26.141899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a943d1b-4c54-4816-8765-2b15f0ac1727 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:26.143300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 675/1364] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:26.148592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf62c-689b-4277-bc4a-065e5ae297ba None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:26.149454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf62c-689b-4277-bc4a-065e5ae297ba None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:26.150006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf62c-689b-4277-bc4a-065e5ae297ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:26.168889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ce8bf62c-689b-4277-bc4a-065e5ae297ba None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:26.170430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ce8bf62c-689b-4277-bc4a-065e5ae297ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:26.181404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 690/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:26.228075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d152a32-60ab-4751-b9af-6835cc7aad5f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:26.228366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d152a32-60ab-4751-b9af-6835cc7aad5f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:26.228648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d152a32-60ab-4751-b9af-6835cc7aad5f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:26.230058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 676/1366] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 3 09:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:49:26.235341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8bcd1-cd43-450b-8037-0bf0bac11645 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:26.235630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8bcd1-cd43-450b-8037-0bf0bac11645 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:26.235907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8bcd1-cd43-450b-8037-0bf0bac11645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:26.253782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c7f8bcd1-cd43-450b-8037-0bf0bac11645 None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:26.254965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c7f8bcd1-cd43-450b-8037-0bf0bac11645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:26.264426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 691/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 3 09:49:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:26.273374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d152a32-60ab-4751-b9af-6835cc7aad5f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:26.290341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d152a32-60ab-4751-b9af-6835cc7aad5f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:26.295912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8727b-6d9a-4055-ad18-73d1062a74f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:26.296559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8727b-6d9a-4055-ad18-73d1062a74f1 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:26.296846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8727b-6d9a-4055-ad18-73d1062a74f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:26.297127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8727b-6d9a-4055-ad18-73d1062a74f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:26.305472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8727b-6d9a-4055-ad18-73d1062a74f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:26.307097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8727b-6d9a-4055-ad18-73d1062a74f1 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:26.316668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 677/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:28.643725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7ee08-a1f3-4732-9a46-4fd232365ee0 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:28.644246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7ee08-a1f3-4732-9a46-4fd232365ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:28.644246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7ee08-a1f3-4732-9a46-4fd232365ee0 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:28.645580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 692/1369] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:28.651184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757be7-a732-4e1c-8fbf-d0fb8c2a54ed None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:28.651912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757be7-a732-4e1c-8fbf-d0fb8c2a54ed None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:28.652224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757be7-a732-4e1c-8fbf-d0fb8c2a54ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:28.670949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2f757be7-a732-4e1c-8fbf-d0fb8c2a54ed None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:28.672325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2f757be7-a732-4e1c-8fbf-d0fb8c2a54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:28.681162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 678/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:28.724906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7ee08-a1f3-4732-9a46-4fd232365ee0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:28.740172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7ee08-a1f3-4732-9a46-4fd232365ee0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:28.745574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eae0b-1907-4c34-85bd-975f5318191a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:28.746374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eae0b-1907-4c34-85bd-975f5318191a service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:28.746666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eae0b-1907-4c34-85bd-975f5318191a service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:28.746952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eae0b-1907-4c34-85bd-975f5318191a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:28.756068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eae0b-1907-4c34-85bd-975f5318191a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:28.757669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eae0b-1907-4c34-85bd-975f5318191a service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:28.767587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 693/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:28.926499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4137e1-ac56-44c6-abab-e10c7962c42b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:28.927001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4137e1-ac56-44c6-abab-e10c7962c42b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:28.927366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4137e1-ac56-44c6-abab-e10c7962c42b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:28.929000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 679/1372] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:49:28.935286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fe7a-09e2-442f-becf-f4a20f247ef7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:28.935578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fe7a-09e2-442f-becf-f4a20f247ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:28.936077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fe7a-09e2-442f-becf-f4a20f247ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:28.955972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1d79fe7a-09e2-442f-becf-f4a20f247ef7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:28.957470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1d79fe7a-09e2-442f-becf-f4a20f247ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:28.966016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 694/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:29.299987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9971bf7-c4bf-4dc1-b9a1-f2e85456d9b8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:29.299987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9971bf7-c4bf-4dc1-b9a1-f2e85456d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:29.299987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9971bf7-c4bf-4dc1-b9a1-f2e85456d9b8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:29.300646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 680/1374] 10.222.0.45 () {54 vars in 963 bytes} [Fri Jun 3 09:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:29.305355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d3e55-2ed6-466c-a0e3-2adbd25fe192 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:29.305726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d3e55-2ed6-466c-a0e3-2adbd25fe192 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:29.306110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d3e55-2ed6-466c-a0e3-2adbd25fe192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:29.357093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dd1d3e55-2ed6-466c-a0e3-2adbd25fe192 None None] MFA Rules not processed for user `795a9ecb4cd8448f81adbe68fdf967b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:29.358402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dd1d3e55-2ed6-466c-a0e3-2adbd25fe192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:29.429564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 695/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Fri Jun 3 09:49:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:29.436980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9971bf7-c4bf-4dc1-b9a1-f2e85456d9b8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:29.448830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9971bf7-c4bf-4dc1-b9a1-f2e85456d9b8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:29.452463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e0021-129c-45cb-ba64-a647ec397ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:29.453383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0021-129c-45cb-ba64-a647ec397ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:29.453790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0021-129c-45cb-ba64-a647ec397ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:29.454174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0021-129c-45cb-ba64-a647ec397ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:29.463833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e0021-129c-45cb-ba64-a647ec397ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:29.465530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e0021-129c-45cb-ba64-a647ec397ba8 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:29.475975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 681/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:31.084071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed20a-cb8a-4f39-bf49-7e497e73510a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:31.084521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed20a-cb8a-4f39-bf49-7e497e73510a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:31.084620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed20a-cb8a-4f39-bf49-7e497e73510a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:31.086030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 696/1377] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:31.091371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9ecd-52d4-469c-9e96-a56eec84e512 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:31.091797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9ecd-52d4-469c-9e96-a56eec84e512 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:31.092040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9ecd-52d4-469c-9e96-a56eec84e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:31.114083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-726c9ecd-52d4-469c-9e96-a56eec84e512 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:31.115300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-726c9ecd-52d4-469c-9e96-a56eec84e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:31.123420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 682/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:31.168599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ed20a-cb8a-4f39-bf49-7e497e73510a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:31.185984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ed20a-cb8a-4f39-bf49-7e497e73510a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:31.196720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599a5ea-ab78-48b7-a611-ba043bec5aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:31.197475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599a5ea-ab78-48b7-a611-ba043bec5aee service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:31.197693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599a5ea-ab78-48b7-a611-ba043bec5aee service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:31.198441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599a5ea-ab78-48b7-a611-ba043bec5aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:31.208433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599a5ea-ab78-48b7-a611-ba043bec5aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:31.210223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599a5ea-ab78-48b7-a611-ba043bec5aee service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:31.215022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:31.222959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 697/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:33.581143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2fca-e72a-4888-ad18-905ea9984dca None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:33.581700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2fca-e72a-4888-ad18-905ea9984dca None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:33.582035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2fca-e72a-4888-ad18-905ea9984dca None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:33.584908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 683/1380] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:33.591006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cedde-a8dc-4e0b-9c58-0bc8935645bc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:33.591427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cedde-a8dc-4e0b-9c58-0bc8935645bc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:33.591731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cedde-a8dc-4e0b-9c58-0bc8935645bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:33.609630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2c7cedde-a8dc-4e0b-9c58-0bc8935645bc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:33.610860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2c7cedde-a8dc-4e0b-9c58-0bc8935645bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:33.618993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 698/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:33.663977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2fca-e72a-4888-ad18-905ea9984dca None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:33.678910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2fca-e72a-4888-ad18-905ea9984dca None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:33.684512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80113769-169c-40d5-9895-455b10c90b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:33.685156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80113769-169c-40d5-9895-455b10c90b4e service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:33.685441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80113769-169c-40d5-9895-455b10c90b4e service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:33.685717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80113769-169c-40d5-9895-455b10c90b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:33.694283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80113769-169c-40d5-9895-455b10c90b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:33.695882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80113769-169c-40d5-9895-455b10c90b4e service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:33.706231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 684/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:35.982034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564023b-a395-4286-b13b-e7a157806781 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:35.982565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564023b-a395-4286-b13b-e7a157806781 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:35.982565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564023b-a395-4286-b13b-e7a157806781 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:35.986591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 699/1383] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:35.989719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d813f0-1d79-49d2-acec-7033bb687823 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:35.990160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d813f0-1d79-49d2-acec-7033bb687823 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:35.990315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d813f0-1d79-49d2-acec-7033bb687823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:36.008221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-99d813f0-1d79-49d2-acec-7033bb687823 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:36.009421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-99d813f0-1d79-49d2-acec-7033bb687823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:36.017906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 685/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:36.060533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564023b-a395-4286-b13b-e7a157806781 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:36.077893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564023b-a395-4286-b13b-e7a157806781 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:36.084130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cc979-1972-48ec-9dcb-d11fa9117e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:36.084978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cc979-1972-48ec-9dcb-d11fa9117e39 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:36.085370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cc979-1972-48ec-9dcb-d11fa9117e39 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:36.085777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cc979-1972-48ec-9dcb-d11fa9117e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:36.095901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cc979-1972-48ec-9dcb-d11fa9117e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:36.097841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cc979-1972-48ec-9dcb-d11fa9117e39 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:36.109285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 700/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:38.484799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ee55-ef91-4f36-9f2d-991d272f4877 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:38.485395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ee55-ef91-4f36-9f2d-991d272f4877 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:38.485495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ee55-ef91-4f36-9f2d-991d272f4877 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:38.487837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 686/1386] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:38.493634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8439e7-f5de-4c01-b16a-9cd31a4759b7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:38.494221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8439e7-f5de-4c01-b16a-9cd31a4759b7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:38.494378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8439e7-f5de-4c01-b16a-9cd31a4759b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:38.514149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5c8439e7-f5de-4c01-b16a-9cd31a4759b7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:38.515471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5c8439e7-f5de-4c01-b16a-9cd31a4759b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:38.523661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 701/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:38.570851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410ee55-ef91-4f36-9f2d-991d272f4877 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:38.585303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410ee55-ef91-4f36-9f2d-991d272f4877 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:38.591037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0cb61-a485-433b-8c74-9f9c1889b9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:38.591680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0cb61-a485-433b-8c74-9f9c1889b9ac service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:38.591967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0cb61-a485-433b-8c74-9f9c1889b9ac service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:38.592293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0cb61-a485-433b-8c74-9f9c1889b9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:38.601149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0cb61-a485-433b-8c74-9f9c1889b9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:38.602779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0cb61-a485-433b-8c74-9f9c1889b9ac service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:38.613728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 687/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:41.015233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd62f8-008d-4fa3-816a-c3cac3fbbd95 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:41.015803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd62f8-008d-4fa3-816a-c3cac3fbbd95 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:41.015803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd62f8-008d-4fa3-816a-c3cac3fbbd95 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:41.017306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 702/1389] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:41.024724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bd6aa-6b42-4266-bbe3-cb45448ed755 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:41.025179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bd6aa-6b42-4266-bbe3-cb45448ed755 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:41.025326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bd6aa-6b42-4266-bbe3-cb45448ed755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:41.043849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-de1bd6aa-6b42-4266-bbe3-cb45448ed755 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:41.045097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-de1bd6aa-6b42-4266-bbe3-cb45448ed755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:41.053292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 688/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:41.099623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd62f8-008d-4fa3-816a-c3cac3fbbd95 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:41.119802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd62f8-008d-4fa3-816a-c3cac3fbbd95 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:41.127889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed2445-6303-429d-b6b8-94e1b7cc7015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:41.129354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2445-6303-429d-b6b8-94e1b7cc7015 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:41.129766 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2445-6303-429d-b6b8-94e1b7cc7015 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:41.130168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2445-6303-429d-b6b8-94e1b7cc7015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:41.142381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed2445-6303-429d-b6b8-94e1b7cc7015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:41.145613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed2445-6303-429d-b6b8-94e1b7cc7015 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:41.159918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 703/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:43.540189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64cc6c-fe64-4e14-a08d-595535296971 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:43.540803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64cc6c-fe64-4e14-a08d-595535296971 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:43.540803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64cc6c-fe64-4e14-a08d-595535296971 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:43.542154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 689/1392] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:43.547397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a45b-9bf3-43aa-9669-023986069e8f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:43.547862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a45b-9bf3-43aa-9669-023986069e8f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:43.547969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a45b-9bf3-43aa-9669-023986069e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:43.566694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-46f6a45b-9bf3-43aa-9669-023986069e8f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:43.567912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-46f6a45b-9bf3-43aa-9669-023986069e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:43.575774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 704/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:43.619681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64cc6c-fe64-4e14-a08d-595535296971 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:43.634635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64cc6c-fe64-4e14-a08d-595535296971 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:43.640066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b80c4-ccb9-4372-9461-675cc5229e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:43.640711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b80c4-ccb9-4372-9461-675cc5229e99 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:43.641030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b80c4-ccb9-4372-9461-675cc5229e99 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:43.641365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b80c4-ccb9-4372-9461-675cc5229e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:43.649573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b80c4-ccb9-4372-9461-675cc5229e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:43.651195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b80c4-ccb9-4372-9461-675cc5229e99 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:43.660807 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 690/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:45.437061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84396-c8d1-4120-abc7-5383d19204e9 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:45.437619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84396-c8d1-4120-abc7-5383d19204e9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:45.437619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84396-c8d1-4120-abc7-5383d19204e9 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:45.439124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 705/1395] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:45.444437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7f27-f471-4584-8089-c268f607a00a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:45.444863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7f27-f471-4584-8089-c268f607a00a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:45.445005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7f27-f471-4584-8089-c268f607a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:45.450940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=52 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:45.463634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-34ef7f27-f471-4584-8089-c268f607a00a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:45.464838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-34ef7f27-f471-4584-8089-c268f607a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:45.473146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 691/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:45.528690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348930c-67bb-4d47-81cc-2d6e6168fe3b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:45.528983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348930c-67bb-4d47-81cc-2d6e6168fe3b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:45.529265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348930c-67bb-4d47-81cc-2d6e6168fe3b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:45.530734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 706/1397] 10.222.0.45 () {54 vars in 962 bytes} [Fri Jun 3 09:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:45.535844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35452-9fa0-4bd2-a437-7e14aed5cdf0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:45.536163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35452-9fa0-4bd2-a437-7e14aed5cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:45.536492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35452-9fa0-4bd2-a437-7e14aed5cdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:45.584845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-79c35452-9fa0-4bd2-a437-7e14aed5cdf0 None None] MFA Rules not processed for user `22cb7c3278594d7a94f3d8c9cae9610a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:45.586104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-79c35452-9fa0-4bd2-a437-7e14aed5cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:45.653293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 692/1398] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Jun 3 09:49:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:45.660742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348930c-67bb-4d47-81cc-2d6e6168fe3b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:45.671468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348930c-67bb-4d47-81cc-2d6e6168fe3b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:45.675047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab707-7374-4ccb-9810-5f84208fc810 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:45.675771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab707-7374-4ccb-9810-5f84208fc810 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:45.676127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab707-7374-4ccb-9810-5f84208fc810 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:45.676537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab707-7374-4ccb-9810-5f84208fc810 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:45.686126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab707-7374-4ccb-9810-5f84208fc810 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:45.687572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab707-7374-4ccb-9810-5f84208fc810 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:45.697774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 707/1399] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:45.926978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e732e-0422-45a4-92fd-6686a58a70cf None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:45.927206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e732e-0422-45a4-92fd-6686a58a70cf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:45.927490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e732e-0422-45a4-92fd-6686a58a70cf None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:45.928860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 693/1400] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:45.934362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a739-9743-4d86-92eb-0d657790f0bb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:45.934677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a739-9743-4d86-92eb-0d657790f0bb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:45.934964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a739-9743-4d86-92eb-0d657790f0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:45.953939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4db4a739-9743-4d86-92eb-0d657790f0bb None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:45.955819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4db4a739-9743-4d86-92eb-0d657790f0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:45.965553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 708/1401] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:49:46.012112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e732e-0422-45a4-92fd-6686a58a70cf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:46.027248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e732e-0422-45a4-92fd-6686a58a70cf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:46.032871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f30d9-b2f6-488b-a7d5-c254e1dd6fba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:46.033505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f30d9-b2f6-488b-a7d5-c254e1dd6fba service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:46.033822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f30d9-b2f6-488b-a7d5-c254e1dd6fba service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:46.034108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f30d9-b2f6-488b-a7d5-c254e1dd6fba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:46.042222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f30d9-b2f6-488b-a7d5-c254e1dd6fba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:46.043803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f30d9-b2f6-488b-a7d5-c254e1dd6fba service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:46.053547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 694/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:49:46.240028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620ac2-13d7-48a8-af6c-38940ba1a9ef None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:46.240472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620ac2-13d7-48a8-af6c-38940ba1a9ef None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:46.240824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620ac2-13d7-48a8-af6c-38940ba1a9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:46.293104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4d620ac2-13d7-48a8-af6c-38940ba1a9ef None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:46.294363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4d620ac2-13d7-48a8-af6c-38940ba1a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:46.358335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 709/1403] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:49:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:46.405117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029069d-8ab1-4fa4-a5fa-f32d14f65cba None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:46.405689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029069d-8ab1-4fa4-a5fa-f32d14f65cba None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:46.406103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029069d-8ab1-4fa4-a5fa-f32d14f65cba None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:46.408362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 695/1404] 10.222.0.45 () {54 vars in 942 bytes} [Fri Jun 3 09:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:49:46.415477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548936-5855-4f29-8c1a-936bdff7b450 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:46.415771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548936-5855-4f29-8c1a-936bdff7b450 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:46.416053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548936-5855-4f29-8c1a-936bdff7b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:46.466521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0d548936-5855-4f29-8c1a-936bdff7b450 None None] MFA Rules not processed for user `b7b8474647dd40b0add7fdba5f24e3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:46.467724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0d548936-5855-4f29-8c1a-936bdff7b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:46.505122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:46.548004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 710/1405] 10.222.0.45 () {58 vars in 1039 bytes} [Fri Jun 3 09:49:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:49:46.558102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029069d-8ab1-4fa4-a5fa-f32d14f65cba None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:46.573158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029069d-8ab1-4fa4-a5fa-f32d14f65cba None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:46.578422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e104fb-8a86-4983-b093-271db9c5799e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:46.579285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e104fb-8a86-4983-b093-271db9c5799e service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:46.580170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e104fb-8a86-4983-b093-271db9c5799e service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:46.580518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e104fb-8a86-4983-b093-271db9c5799e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:46.589884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e104fb-8a86-4983-b093-271db9c5799e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:46.591602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e104fb-8a86-4983-b093-271db9c5799e service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:46.602025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 696/1406] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 09:49:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:49:48.400109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0563358-36d1-409c-af2b-d2134d834569 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:48.400658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0563358-36d1-409c-af2b-d2134d834569 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:48.400935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0563358-36d1-409c-af2b-d2134d834569 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:48.403022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 711/1407] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:49:48.409438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76b266-a931-4f9e-97db-5750cadc0cc3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:48.410147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76b266-a931-4f9e-97db-5750cadc0cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:48.410603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76b266-a931-4f9e-97db-5750cadc0cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:48.431101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4c76b266-a931-4f9e-97db-5750cadc0cc3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:49:48.434152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4c76b266-a931-4f9e-97db-5750cadc0cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:49:48.443357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 697/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:49:48.491667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0563358-36d1-409c-af2b-d2134d834569 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:49:48.506338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0563358-36d1-409c-af2b-d2134d834569 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:49:48.512038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d2612-9ce6-4c62-ad93-64d032de3105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:49:48.512746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2612-9ce6-4c62-ad93-64d032de3105 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:49:48.513055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2612-9ce6-4c62-ad93-64d032de3105 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:49:48.513338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2612-9ce6-4c62-ad93-64d032de3105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:49:48.521791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d2612-9ce6-4c62-ad93-64d032de3105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:49:48.523390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d2612-9ce6-4c62-ad93-64d032de3105 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:49:48.538678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 712/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:49:58.450675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=55 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:58.528938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=21 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:09.881505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbcd8-4d0e-451c-b60d-949df7cd41f2 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:09.882173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbcd8-4d0e-451c-b60d-949df7cd41f2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:09.882173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbcd8-4d0e-451c-b60d-949df7cd41f2 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:09.883482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 698/1410] 10.222.0.45 () {54 vars in 918 bytes} [Fri Jun 3 09:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:09.888520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863cb13-6f1f-4e3e-92d2-0eb4a3d1a259 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:09.889006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863cb13-6f1f-4e3e-92d2-0eb4a3d1a259 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:09.889114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863cb13-6f1f-4e3e-92d2-0eb4a3d1a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:09.906914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0863cb13-6f1f-4e3e-92d2-0eb4a3d1a259 None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:09.908092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0863cb13-6f1f-4e3e-92d2-0eb4a3d1a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:09.916298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 713/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Jun 3 09:50:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:09.930453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39139d9-cc2c-4dc9-a60b-faff1c4b2ea7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:09.930840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39139d9-cc2c-4dc9-a60b-faff1c4b2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:09.931217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39139d9-cc2c-4dc9-a60b-faff1c4b2ea7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:09.932656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 699/1412] 10.222.0.45 () {54 vars in 918 bytes} [Fri Jun 3 09:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:09.937152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a543-8030-4e22-ad4d-5620b8b307cc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:09.937442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a543-8030-4e22-ad4d-5620b8b307cc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:09.937720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a543-8030-4e22-ad4d-5620b8b307cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:09.955370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-71a2a543-8030-4e22-ad4d-5620b8b307cc None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:09.956516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-71a2a543-8030-4e22-ad4d-5620b8b307cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:09.965385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 714/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Jun 3 09:50:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:12.677531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60f69-6699-4d4b-bbc0-594379f7fa97 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:12.678113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60f69-6699-4d4b-bbc0-594379f7fa97 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:12.678113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60f69-6699-4d4b-bbc0-594379f7fa97 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:12.679420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:12.684638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4becab-cdce-48eb-8087-525fbe851a88 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:12.685080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4becab-cdce-48eb-8087-525fbe851a88 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:12.685192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4becab-cdce-48eb-8087-525fbe851a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:12.703091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2a4becab-cdce-48eb-8087-525fbe851a88 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:12.704264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2a4becab-cdce-48eb-8087-525fbe851a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:12.712031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:12.756191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f60f69-6699-4d4b-bbc0-594379f7fa97 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:12.770590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f60f69-6699-4d4b-bbc0-594379f7fa97 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:12.775850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239dc91-26eb-47db-8e73-40eca864707c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:12.776496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239dc91-26eb-47db-8e73-40eca864707c service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:12.777041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239dc91-26eb-47db-8e73-40eca864707c service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:12.777318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239dc91-26eb-47db-8e73-40eca864707c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:12.785132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239dc91-26eb-47db-8e73-40eca864707c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:12.786732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239dc91-26eb-47db-8e73-40eca864707c service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:12.795731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 701/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:13.772615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4113-07f8-4b36-9590-4eab30d2eca7 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:13.773054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4113-07f8-4b36-9590-4eab30d2eca7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:13.773159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4113-07f8-4b36-9590-4eab30d2eca7 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:13.774575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:13.779780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42751e8d-ce0c-4b0d-b95c-43c481e59ad5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:13.780218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42751e8d-ce0c-4b0d-b95c-43c481e59ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:13.780370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42751e8d-ce0c-4b0d-b95c-43c481e59ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:13.798295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-42751e8d-ce0c-4b0d-b95c-43c481e59ad5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:13.799469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-42751e8d-ce0c-4b0d-b95c-43c481e59ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:13.807753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:13.960192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4113-07f8-4b36-9590-4eab30d2eca7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:13.974806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4113-07f8-4b36-9590-4eab30d2eca7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:13.980137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f65b1-57cb-4d10-8696-b4c30c3d9080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:13.980764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f65b1-57cb-4d10-8696-b4c30c3d9080 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:13.981052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f65b1-57cb-4d10-8696-b4c30c3d9080 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:13.981334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f65b1-57cb-4d10-8696-b4c30c3d9080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:13.990011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f65b1-57cb-4d10-8696-b4c30c3d9080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:13.991581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f65b1-57cb-4d10-8696-b4c30c3d9080 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:14.000930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 717/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:14.924594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd63631-2d4d-420c-9190-a4a64df14d02 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:14.925144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd63631-2d4d-420c-9190-a4a64df14d02 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:14.925266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd63631-2d4d-420c-9190-a4a64df14d02 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:14.927170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:14.932769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30f960-5c06-49f7-bbb7-3dd37fa82bad None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:14.933405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30f960-5c06-49f7-bbb7-3dd37fa82bad None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:14.933405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30f960-5c06-49f7-bbb7-3dd37fa82bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:14.951962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ac30f960-5c06-49f7-bbb7-3dd37fa82bad None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:14.954260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ac30f960-5c06-49f7-bbb7-3dd37fa82bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:14.964406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:15.113580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd63631-2d4d-420c-9190-a4a64df14d02 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:15.127606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd63631-2d4d-420c-9190-a4a64df14d02 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:15.133496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4d221-21dc-47f9-b281-ff8724a36548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:15.134163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d221-21dc-47f9-b281-ff8724a36548 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:15.134454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d221-21dc-47f9-b281-ff8724a36548 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:15.134740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d221-21dc-47f9-b281-ff8724a36548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:15.142745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4d221-21dc-47f9-b281-ff8724a36548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:15.144383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4d221-21dc-47f9-b281-ff8724a36548 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:15.154012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 704/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:16.073932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d55a-8b0e-4fb8-92b1-2a7cfa0a5a52 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:16.074471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d55a-8b0e-4fb8-92b1-2a7cfa0a5a52 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:16.074471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d55a-8b0e-4fb8-92b1-2a7cfa0a5a52 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:16.075801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:16.080897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c2c4-892d-48d3-8037-3ef8d4d39367 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:16.081327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c2c4-892d-48d3-8037-3ef8d4d39367 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:16.081465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c2c4-892d-48d3-8037-3ef8d4d39367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:16.099713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-17c9c2c4-892d-48d3-8037-3ef8d4d39367 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:16.100901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-17c9c2c4-892d-48d3-8037-3ef8d4d39367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:16.108618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:16.256240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d55a-8b0e-4fb8-92b1-2a7cfa0a5a52 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:16.270883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d55a-8b0e-4fb8-92b1-2a7cfa0a5a52 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:16.276148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88856deb-f6a8-4268-aa20-afdedc799d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:16.277020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856deb-f6a8-4268-aa20-afdedc799d5c service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:16.277304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856deb-f6a8-4268-aa20-afdedc799d5c service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:16.277580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856deb-f6a8-4268-aa20-afdedc799d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:16.285388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88856deb-f6a8-4268-aa20-afdedc799d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:16.286990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88856deb-f6a8-4268-aa20-afdedc799d5c service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:16.296031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 720/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:17.196989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214640e6-0631-4446-90ab-1e0f39446e21 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:17.197566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214640e6-0631-4446-90ab-1e0f39446e21 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:17.197665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214640e6-0631-4446-90ab-1e0f39446e21 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:17.199088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:17.204192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1d51-4d69-4818-ac74-1d29933623fa None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:17.204643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1d51-4d69-4818-ac74-1d29933623fa None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:17.204757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1d51-4d69-4818-ac74-1d29933623fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:17.223461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7b9a1d51-4d69-4818-ac74-1d29933623fa None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:17.224643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7b9a1d51-4d69-4818-ac74-1d29933623fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:17.232359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:17.379933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214640e6-0631-4446-90ab-1e0f39446e21 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:17.394678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214640e6-0631-4446-90ab-1e0f39446e21 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:17.400242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41beeb-f7a1-4d51-bfaa-1844e2bb8f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:17.401030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41beeb-f7a1-4d51-bfaa-1844e2bb8f53 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:17.401323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41beeb-f7a1-4d51-bfaa-1844e2bb8f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:17.401962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41beeb-f7a1-4d51-bfaa-1844e2bb8f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:17.410839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41beeb-f7a1-4d51-bfaa-1844e2bb8f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:17.412405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41beeb-f7a1-4d51-bfaa-1844e2bb8f53 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:17.421672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 707/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:18.269272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878909-c596-4811-9a1a-384bcad4ef8f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:18.269841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878909-c596-4811-9a1a-384bcad4ef8f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:18.269944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878909-c596-4811-9a1a-384bcad4ef8f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:18.271264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:18.276399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587969b-3b87-4c73-834d-780e2facdabe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:18.277061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587969b-3b87-4c73-834d-780e2facdabe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:18.277220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587969b-3b87-4c73-834d-780e2facdabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:18.295481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b587969b-3b87-4c73-834d-780e2facdabe None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:18.296670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b587969b-3b87-4c73-834d-780e2facdabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:18.304978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:18.451687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59878909-c596-4811-9a1a-384bcad4ef8f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:18.466610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59878909-c596-4811-9a1a-384bcad4ef8f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:18.471869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30463-c354-49c9-a6dc-b2335ccffb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:18.473025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30463-c354-49c9-a6dc-b2335ccffb48 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:18.473305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30463-c354-49c9-a6dc-b2335ccffb48 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:18.473576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30463-c354-49c9-a6dc-b2335ccffb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:18.481551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30463-c354-49c9-a6dc-b2335ccffb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:18.483151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30463-c354-49c9-a6dc-b2335ccffb48 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:18.492803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 723/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:19.329252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb5bc2-758d-4283-83e5-9cbffe87bc8c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:19.329857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb5bc2-758d-4283-83e5-9cbffe87bc8c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:19.329857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb5bc2-758d-4283-83e5-9cbffe87bc8c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:19.331122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:19.335963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e5787-bf0b-4c5e-8f87-04c6184c5159 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:19.336374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e5787-bf0b-4c5e-8f87-04c6184c5159 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:19.336533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e5787-bf0b-4c5e-8f87-04c6184c5159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:19.355469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ad8e5787-bf0b-4c5e-8f87-04c6184c5159 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:19.356658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ad8e5787-bf0b-4c5e-8f87-04c6184c5159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:19.364935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:19.512443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb5bc2-758d-4283-83e5-9cbffe87bc8c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:19.527240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb5bc2-758d-4283-83e5-9cbffe87bc8c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:19.532593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e7568-ee87-4002-b188-22772869fb5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:19.533221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7568-ee87-4002-b188-22772869fb5c service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:19.533511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7568-ee87-4002-b188-22772869fb5c service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:19.533823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7568-ee87-4002-b188-22772869fb5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:19.542371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e7568-ee87-4002-b188-22772869fb5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:19.543947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e7568-ee87-4002-b188-22772869fb5c service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:19.553134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 710/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:20.387686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b3c8-6276-45c8-af99-7d9dedf910be None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:20.388214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b3c8-6276-45c8-af99-7d9dedf910be None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:20.388327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b3c8-6276-45c8-af99-7d9dedf910be None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:20.389649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:20.394755 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01082-962e-41e3-a39e-0b5d5adb6483 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:20.395146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01082-962e-41e3-a39e-0b5d5adb6483 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:20.395314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01082-962e-41e3-a39e-0b5d5adb6483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:20.413078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9ad01082-962e-41e3-a39e-0b5d5adb6483 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:20.414290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ad01082-962e-41e3-a39e-0b5d5adb6483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:20.422094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:20.571600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b3c8-6276-45c8-af99-7d9dedf910be None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:20.585441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b3c8-6276-45c8-af99-7d9dedf910be None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:20.590709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240828-0fb3-45f5-a097-30a57c1c93aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:20.591334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240828-0fb3-45f5-a097-30a57c1c93aa service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:20.591616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240828-0fb3-45f5-a097-30a57c1c93aa service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:20.591890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240828-0fb3-45f5-a097-30a57c1c93aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:20.600324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240828-0fb3-45f5-a097-30a57c1c93aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:20.601939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240828-0fb3-45f5-a097-30a57c1c93aa service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:20.611059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 726/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:21.459539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8169e6-6577-4d99-98fb-fabd075acecc None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:21.460036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8169e6-6577-4d99-98fb-fabd075acecc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:21.460149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8169e6-6577-4d99-98fb-fabd075acecc None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:21.461499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:21.466487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753950f1-fc68-430f-88f6-951fbcad1720 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:21.466887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753950f1-fc68-430f-88f6-951fbcad1720 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:21.467045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753950f1-fc68-430f-88f6-951fbcad1720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:21.485057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-753950f1-fc68-430f-88f6-951fbcad1720 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:21.486250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-753950f1-fc68-430f-88f6-951fbcad1720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:21.494438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:21.642387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8169e6-6577-4d99-98fb-fabd075acecc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:21.656947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8169e6-6577-4d99-98fb-fabd075acecc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:21.666337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514b7c0-5353-46cf-94f0-d4497ae51e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:21.667256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514b7c0-5353-46cf-94f0-d4497ae51e79 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:21.667546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514b7c0-5353-46cf-94f0-d4497ae51e79 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:21.667827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514b7c0-5353-46cf-94f0-d4497ae51e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:21.677928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514b7c0-5353-46cf-94f0-d4497ae51e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:21.679569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514b7c0-5353-46cf-94f0-d4497ae51e79 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:21.688829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 713/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:50:23.798424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acf1b-e124-4ac1-85c9-aaf81c59a985 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:23.798931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acf1b-e124-4ac1-85c9-aaf81c59a985 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:23.799058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acf1b-e124-4ac1-85c9-aaf81c59a985 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:23.800377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:23.805546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2076870-017e-4b58-8671-7b0c563f6772 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:23.805961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2076870-017e-4b58-8671-7b0c563f6772 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:23.806155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2076870-017e-4b58-8671-7b0c563f6772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:23.824658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a2076870-017e-4b58-8671-7b0c563f6772 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:23.825875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a2076870-017e-4b58-8671-7b0c563f6772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:23.834087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:23.871601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acf1b-e124-4ac1-85c9-aaf81c59a985 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:23.882686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acf1b-e124-4ac1-85c9-aaf81c59a985 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:23.886201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee53df2-e2c2-4177-840a-8176ea6ffb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:23.886824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee53df2-e2c2-4177-840a-8176ea6ffb09 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:23.887109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee53df2-e2c2-4177-840a-8176ea6ffb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:23.887388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee53df2-e2c2-4177-840a-8176ea6ffb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:23.896667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee53df2-e2c2-4177-840a-8176ea6ffb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:23.898122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee53df2-e2c2-4177-840a-8176ea6ffb09 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:23.907561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 729/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:26.280137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e28a1-a811-4582-abf9-55385060949c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:26.280700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e28a1-a811-4582-abf9-55385060949c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:26.280700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e28a1-a811-4582-abf9-55385060949c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:26.282185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:26.287496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3993-447c-42c0-b3aa-19e3478cbfe5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:26.287985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3993-447c-42c0-b3aa-19e3478cbfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:26.288087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3993-447c-42c0-b3aa-19e3478cbfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:26.306137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cbbd3993-447c-42c0-b3aa-19e3478cbfe5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:26.307324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cbbd3993-447c-42c0-b3aa-19e3478cbfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:26.315141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:26.353266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e28a1-a811-4582-abf9-55385060949c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:26.354951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-254e28a1-a811-4582-abf9-55385060949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:26.367986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e28a1-a811-4582-abf9-55385060949c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:26.371560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb1d54-8afb-46fd-a09e-43af0765e972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:26.372225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1d54-8afb-46fd-a09e-43af0765e972 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:26.372511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1d54-8afb-46fd-a09e-43af0765e972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:26.372793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1d54-8afb-46fd-a09e-43af0765e972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:26.382352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1d54-8afb-46fd-a09e-43af0765e972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:26.383774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1d54-8afb-46fd-a09e-43af0765e972 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:26.393127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 716/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:50:28.997194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e279-7629-403a-81f2-1a3bb5312acb None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:28.997803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e279-7629-403a-81f2-1a3bb5312acb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:28.997803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e279-7629-403a-81f2-1a3bb5312acb None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:28.999140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:29.004389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fbb91-df03-4af6-a527-e22eae779342 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:29.004815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fbb91-df03-4af6-a527-e22eae779342 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:29.004937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fbb91-df03-4af6-a527-e22eae779342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:29.022591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ab7fbb91-df03-4af6-a527-e22eae779342 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:29.023764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ab7fbb91-df03-4af6-a527-e22eae779342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:29.031615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:29.070878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69e279-7629-403a-81f2-1a3bb5312acb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:29.081485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69e279-7629-403a-81f2-1a3bb5312acb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:29.084972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2effc4-0da5-4548-a4a0-7ad81eeddfb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:29.085595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2effc4-0da5-4548-a4a0-7ad81eeddfb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:29.085921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2effc4-0da5-4548-a4a0-7ad81eeddfb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:29.086201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2effc4-0da5-4548-a4a0-7ad81eeddfb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:29.094920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2effc4-0da5-4548-a4a0-7ad81eeddfb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:29.096339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2effc4-0da5-4548-a4a0-7ad81eeddfb2 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:29.107044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 732/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:31.495690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7be45-ec57-43cf-9ba0-39af34077f73 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:31.496277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7be45-ec57-43cf-9ba0-39af34077f73 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:31.496277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7be45-ec57-43cf-9ba0-39af34077f73 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:31.497625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:31.502955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf28a-1fee-428f-9ff5-c4c43f32f9e9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:31.503954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf28a-1fee-428f-9ff5-c4c43f32f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:31.504066 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf28a-1fee-428f-9ff5-c4c43f32f9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:31.521187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-77fcf28a-1fee-428f-9ff5-c4c43f32f9e9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:31.522410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-77fcf28a-1fee-428f-9ff5-c4c43f32f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:31.530219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:31.568302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7be45-ec57-43cf-9ba0-39af34077f73 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:31.578925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7be45-ec57-43cf-9ba0-39af34077f73 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:31.582462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84cfe8-2ecb-48fb-95d1-a082b95c3c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:31.583130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84cfe8-2ecb-48fb-95d1-a082b95c3c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:31.583434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84cfe8-2ecb-48fb-95d1-a082b95c3c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:31.583714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84cfe8-2ecb-48fb-95d1-a082b95c3c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:31.592793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84cfe8-2ecb-48fb-95d1-a082b95c3c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:31.594258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84cfe8-2ecb-48fb-95d1-a082b95c3c89 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:31.603380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 719/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:33.978074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fac0-5503-448c-8565-ac4972b63fbc None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:33.978635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fac0-5503-448c-8565-ac4972b63fbc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:33.978635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fac0-5503-448c-8565-ac4972b63fbc None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:33.980387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:33.985545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc35be-4132-4b80-b261-f77d202cd0e6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:33.986010 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc35be-4132-4b80-b261-f77d202cd0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:33.986157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc35be-4132-4b80-b261-f77d202cd0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:34.003795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f6bc35be-4132-4b80-b261-f77d202cd0e6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:34.004979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6bc35be-4132-4b80-b261-f77d202cd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:34.012730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:34.051253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5fac0-5503-448c-8565-ac4972b63fbc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:34.061705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5fac0-5503-448c-8565-ac4972b63fbc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:34.065198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035b7d-6e93-459a-8f7f-a3a48b6c914e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:34.066382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035b7d-6e93-459a-8f7f-a3a48b6c914e service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:34.066666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035b7d-6e93-459a-8f7f-a3a48b6c914e service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:34.066941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035b7d-6e93-459a-8f7f-a3a48b6c914e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:34.075671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035b7d-6e93-459a-8f7f-a3a48b6c914e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:34.077092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035b7d-6e93-459a-8f7f-a3a48b6c914e service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:34.086794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 735/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:36.398656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c430c-539d-4463-9646-a84fa2446d3f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:36.399130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c430c-539d-4463-9646-a84fa2446d3f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:36.399257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c430c-539d-4463-9646-a84fa2446d3f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:36.400643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:36.406290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c70f-9705-491d-840a-6485e6bb5788 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:36.406740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c70f-9705-491d-840a-6485e6bb5788 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:36.406859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c70f-9705-491d-840a-6485e6bb5788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:36.424582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-99c7c70f-9705-491d-840a-6485e6bb5788 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:36.425860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-99c7c70f-9705-491d-840a-6485e6bb5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:36.433588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:36.472487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c430c-539d-4463-9646-a84fa2446d3f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:36.483034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c430c-539d-4463-9646-a84fa2446d3f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:36.486544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9834a8-8fdc-4b4d-96cd-eb55502e0966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:36.487234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9834a8-8fdc-4b4d-96cd-eb55502e0966 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:36.487516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9834a8-8fdc-4b4d-96cd-eb55502e0966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:36.487811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9834a8-8fdc-4b4d-96cd-eb55502e0966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:36.496512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9834a8-8fdc-4b4d-96cd-eb55502e0966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:36.497981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9834a8-8fdc-4b4d-96cd-eb55502e0966 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:36.507634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 722/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:38.813992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22002c-db3f-409f-963d-99beec646f3b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:38.814585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22002c-db3f-409f-963d-99beec646f3b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:38.814585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22002c-db3f-409f-963d-99beec646f3b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:38.816626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:38.822003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b10ab-1bee-4976-84bb-bfebe20fa17b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:38.822435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b10ab-1bee-4976-84bb-bfebe20fa17b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:38.822573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b10ab-1bee-4976-84bb-bfebe20fa17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:38.828622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=70 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:38.842104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8c1b10ab-1bee-4976-84bb-bfebe20fa17b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:38.843313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8c1b10ab-1bee-4976-84bb-bfebe20fa17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:38.851288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:38.888484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22002c-db3f-409f-963d-99beec646f3b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:38.894419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=73 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:38.900765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22002c-db3f-409f-963d-99beec646f3b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:38.904478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52bb49-f197-4c18-8bdc-c33eba2da6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:38.905107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52bb49-f197-4c18-8bdc-c33eba2da6ec service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:38.905391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52bb49-f197-4c18-8bdc-c33eba2da6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:38.905668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52bb49-f197-4c18-8bdc-c33eba2da6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:38.914502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52bb49-f197-4c18-8bdc-c33eba2da6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:38.915917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52bb49-f197-4c18-8bdc-c33eba2da6ec service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:38.925617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 738/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:41.174092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fa73-2b37-4e82-abdd-7cefc96800c4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:41.174632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fa73-2b37-4e82-abdd-7cefc96800c4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:41.174753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fa73-2b37-4e82-abdd-7cefc96800c4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:41.176070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:41.181582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62a7cf-2adf-4985-8bfa-e44d07e995c0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:41.182109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62a7cf-2adf-4985-8bfa-e44d07e995c0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:41.182259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62a7cf-2adf-4985-8bfa-e44d07e995c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:41.205016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dc62a7cf-2adf-4985-8bfa-e44d07e995c0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:41.207345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dc62a7cf-2adf-4985-8bfa-e44d07e995c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:41.215851 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:41.253778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97fa73-2b37-4e82-abdd-7cefc96800c4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:41.264331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97fa73-2b37-4e82-abdd-7cefc96800c4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:41.267827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6c771-f8b8-4dab-9dec-9bd6beb8a655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:41.268456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c771-f8b8-4dab-9dec-9bd6beb8a655 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:41.269250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c771-f8b8-4dab-9dec-9bd6beb8a655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:41.269526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c771-f8b8-4dab-9dec-9bd6beb8a655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:41.278498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6c771-f8b8-4dab-9dec-9bd6beb8a655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:41.279921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6c771-f8b8-4dab-9dec-9bd6beb8a655 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:41.290041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 725/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:43.554921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd69df-67a2-4a1c-ad92-3419d1a48479 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:43.555480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd69df-67a2-4a1c-ad92-3419d1a48479 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:43.555480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd69df-67a2-4a1c-ad92-3419d1a48479 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:43.556831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:43.562185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572a356-58df-4a74-8e76-f4285490351a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:43.562587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572a356-58df-4a74-8e76-f4285490351a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:43.562746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572a356-58df-4a74-8e76-f4285490351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:43.580766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f572a356-58df-4a74-8e76-f4285490351a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:43.582046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f572a356-58df-4a74-8e76-f4285490351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:43.589670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:43.625373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd69df-67a2-4a1c-ad92-3419d1a48479 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:43.636632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd69df-67a2-4a1c-ad92-3419d1a48479 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:43.640172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26123db7-c7b9-4bbc-893d-ca51348d008b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:43.640795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123db7-c7b9-4bbc-893d-ca51348d008b service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:43.641080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123db7-c7b9-4bbc-893d-ca51348d008b service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:43.641409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123db7-c7b9-4bbc-893d-ca51348d008b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:43.650416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26123db7-c7b9-4bbc-893d-ca51348d008b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:43.652099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26123db7-c7b9-4bbc-893d-ca51348d008b service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:43.661287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 741/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:45.914659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d2139-1381-4462-b826-b9b74af72b14 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:45.915223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d2139-1381-4462-b826-b9b74af72b14 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:45.915223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d2139-1381-4462-b826-b9b74af72b14 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:45.916649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:50:45.922142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648709e-6537-4ea1-91eb-fd38a7ca2d2b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:45.922601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648709e-6537-4ea1-91eb-fd38a7ca2d2b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:45.922719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648709e-6537-4ea1-91eb-fd38a7ca2d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:45.941421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f648709e-6537-4ea1-91eb-fd38a7ca2d2b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:50:45.942686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f648709e-6537-4ea1-91eb-fd38a7ca2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:50:45.950478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:50:45.986649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d2139-1381-4462-b826-b9b74af72b14 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:50:45.997674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d2139-1381-4462-b826-b9b74af72b14 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:50:46.001194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995ac4c-79ab-47a7-ada2-4567719b12f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:50:46.001850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ac4c-79ab-47a7-ada2-4567719b12f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:50:46.002135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ac4c-79ab-47a7-ada2-4567719b12f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:50:46.002411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ac4c-79ab-47a7-ada2-4567719b12f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:50:46.011578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ac4c-79ab-47a7-ada2-4567719b12f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:50:46.012991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ac4c-79ab-47a7-ada2-4567719b12f7 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:50:46.022078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 728/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:50:55.935687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=17 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:56.018032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=17 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:51:17.842299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7f455-9e63-4740-af0c-a21a5d4fca3c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:17.842846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7f455-9e63-4740-af0c-a21a5d4fca3c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:17.842846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7f455-9e63-4740-af0c-a21a5d4fca3c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:17.844243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 743/1471] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:17.849624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94552a9-d786-40df-847a-5b7c84ddf8fb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:17.850177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94552a9-d786-40df-847a-5b7c84ddf8fb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:17.850286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94552a9-d786-40df-847a-5b7c84ddf8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:17.867395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f94552a9-d786-40df-847a-5b7c84ddf8fb None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:17.868586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f94552a9-d786-40df-847a-5b7c84ddf8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:17.876259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 729/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:17.923548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f85a3-50a0-4d17-b19a-07d5f597d6e2 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:17.923836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f85a3-50a0-4d17-b19a-07d5f597d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:17.924604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f85a3-50a0-4d17-b19a-07d5f597d6e2 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:17.925993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 744/1473] 10.222.0.45 () {54 vars in 962 bytes} [Fri Jun 3 09:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:17.930782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa026-27f3-494c-bd3d-9149538336b5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:17.931069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa026-27f3-494c-bd3d-9149538336b5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:17.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa026-27f3-494c-bd3d-9149538336b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:17.949210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-56afa026-27f3-494c-bd3d-9149538336b5 None None] MFA Rules not processed for user `22cb7c3278594d7a94f3d8c9cae9610a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:17.950392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-56afa026-27f3-494c-bd3d-9149538336b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:17.956630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 730/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Jun 3 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:17.963667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f85a3-50a0-4d17-b19a-07d5f597d6e2 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:51:17.973735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f85a3-50a0-4d17-b19a-07d5f597d6e2 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:51:17.977107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0cea4-5e63-4da4-9a24-06826d6ebfba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:51:17.977708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0cea4-5e63-4da4-9a24-06826d6ebfba service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:17.978027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0cea4-5e63-4da4-9a24-06826d6ebfba service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:17.978303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0cea4-5e63-4da4-9a24-06826d6ebfba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:17.987312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0cea4-5e63-4da4-9a24-06826d6ebfba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:51:17.988713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0cea4-5e63-4da4-9a24-06826d6ebfba service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:51:17.997650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 745/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:51:20.323887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91249b2-c5a0-4897-b785-02e455cbd3d2 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:20.324463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91249b2-c5a0-4897-b785-02e455cbd3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:20.324463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91249b2-c5a0-4897-b785-02e455cbd3d2 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:20.325842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 731/1476] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:20.331653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f28c63-359b-4194-b4da-18231e38a123 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:20.332098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f28c63-359b-4194-b4da-18231e38a123 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:20.332209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f28c63-359b-4194-b4da-18231e38a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:20.350098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e7f28c63-359b-4194-b4da-18231e38a123 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:20.351303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e7f28c63-359b-4194-b4da-18231e38a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:20.359166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 746/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:20.382258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91249b2-c5a0-4897-b785-02e455cbd3d2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:51:20.395276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91249b2-c5a0-4897-b785-02e455cbd3d2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:51:20.399654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf0014-9e21-43ec-ba5d-64b3d91b738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:51:20.400303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf0014-9e21-43ec-ba5d-64b3d91b738e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:20.400588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf0014-9e21-43ec-ba5d-64b3d91b738e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:20.400868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf0014-9e21-43ec-ba5d-64b3d91b738e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:20.401595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf0014-9e21-43ec-ba5d-64b3d91b738e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:51:20.403638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-8adf0014-9e21-43ec-ba5d-64b3d91b738e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:51:20.403638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:51:20.403638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:51:20.404762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf0014-9e21-43ec-ba5d-64b3d91b738e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:51:20.423974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 732/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Jun 3 09:51:20 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:51:22.668420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161107-d833-4dd4-9096-647205e0c472 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:22.668892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161107-d833-4dd4-9096-647205e0c472 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:22.668892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161107-d833-4dd4-9096-647205e0c472 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:22.670301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 747/1479] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:22.675584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e31a-d823-4325-9e9d-30a1d137ac06 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:22.676006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e31a-d823-4325-9e9d-30a1d137ac06 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:22.676157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e31a-d823-4325-9e9d-30a1d137ac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:22.693644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5523e31a-d823-4325-9e9d-30a1d137ac06 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:22.694898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5523e31a-d823-4325-9e9d-30a1d137ac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:22.702614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 733/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:22.746289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161107-d833-4dd4-9096-647205e0c472 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:51:22.760926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161107-d833-4dd4-9096-647205e0c472 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:51:22.766552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe243cfe-6b5d-4c59-bdfa-2d3f208727bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:51:22.767230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe243cfe-6b5d-4c59-bdfa-2d3f208727bb service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:22.767516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe243cfe-6b5d-4c59-bdfa-2d3f208727bb service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:22.767837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe243cfe-6b5d-4c59-bdfa-2d3f208727bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:22.776646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe243cfe-6b5d-4c59-bdfa-2d3f208727bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:51:22.778548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe243cfe-6b5d-4c59-bdfa-2d3f208727bb service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:51:22.787821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 748/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:25.165106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edecd4-345d-4785-a4cd-b350cd2716b4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:25.165644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edecd4-345d-4785-a4cd-b350cd2716b4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:25.165644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edecd4-345d-4785-a4cd-b350cd2716b4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:25.167053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 734/1482] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:25.172341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519894b-a15c-4ced-8a3c-50124cef6671 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:25.172746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519894b-a15c-4ced-8a3c-50124cef6671 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:25.172909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519894b-a15c-4ced-8a3c-50124cef6671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:25.192491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0519894b-a15c-4ced-8a3c-50124cef6671 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:25.193678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0519894b-a15c-4ced-8a3c-50124cef6671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:25.201458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 749/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:25.237141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edecd4-345d-4785-a4cd-b350cd2716b4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:51:25.247592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edecd4-345d-4785-a4cd-b350cd2716b4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:51:25.251075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c60a4-a7dd-4d96-8fe7-72b6da8841cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:51:25.251701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c60a4-a7dd-4d96-8fe7-72b6da8841cd service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:25.252503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c60a4-a7dd-4d96-8fe7-72b6da8841cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:25.252780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c60a4-a7dd-4d96-8fe7-72b6da8841cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:25.261393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c60a4-a7dd-4d96-8fe7-72b6da8841cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:51:25.262862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c60a4-a7dd-4d96-8fe7-72b6da8841cd service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:51:25.272552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 735/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:27.561917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445e09-5e3f-4ffa-acb6-06df030efe44 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:27.562445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445e09-5e3f-4ffa-acb6-06df030efe44 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:27.562572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445e09-5e3f-4ffa-acb6-06df030efe44 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:27.563866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 750/1485] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:27.569107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90f30-3579-4299-b2de-a053ceca7145 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:27.569539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90f30-3579-4299-b2de-a053ceca7145 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:27.569685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90f30-3579-4299-b2de-a053ceca7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:27.586944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1fc90f30-3579-4299-b2de-a053ceca7145 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:27.588127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1fc90f30-3579-4299-b2de-a053ceca7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:27.596270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 736/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:27.633987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7445e09-5e3f-4ffa-acb6-06df030efe44 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:51:27.645480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7445e09-5e3f-4ffa-acb6-06df030efe44 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:51:27.648927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ee25-65c5-4678-869c-cebe3012c345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:51:27.649587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ee25-65c5-4678-869c-cebe3012c345 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:27.649916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ee25-65c5-4678-869c-cebe3012c345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:27.650200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ee25-65c5-4678-869c-cebe3012c345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:27.659773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1ee25-65c5-4678-869c-cebe3012c345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:51:27.661211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1ee25-65c5-4678-869c-cebe3012c345 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:51:27.670541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 751/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:30.036512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7d71-a51f-40cd-b2b2-67e4f6d3c54b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:30.037072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7d71-a51f-40cd-b2b2-67e4f6d3c54b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:30.037072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7d71-a51f-40cd-b2b2-67e4f6d3c54b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:30.038569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 737/1488] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:30.043659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5c01-272f-410e-bf08-bc8b9e88f589 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:30.044083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5c01-272f-410e-bf08-bc8b9e88f589 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:30.044231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5c01-272f-410e-bf08-bc8b9e88f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:30.062423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-830f5c01-272f-410e-bf08-bc8b9e88f589 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:30.063549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-830f5c01-272f-410e-bf08-bc8b9e88f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:30.071865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 752/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:30.111847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7d71-a51f-40cd-b2b2-67e4f6d3c54b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:51:30.122575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7d71-a51f-40cd-b2b2-67e4f6d3c54b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:51:30.126134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccb691-6938-4c1c-89b0-9991dec27266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:51:30.126858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb691-6938-4c1c-89b0-9991dec27266 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:30.127652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb691-6938-4c1c-89b0-9991dec27266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:30.127934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb691-6938-4c1c-89b0-9991dec27266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:30.137997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccb691-6938-4c1c-89b0-9991dec27266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:51:30.139465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccb691-6938-4c1c-89b0-9991dec27266 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:51:30.149917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 738/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:32.613452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632bd1d-a1ff-4095-89da-375104e8f062 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:32.614070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632bd1d-a1ff-4095-89da-375104e8f062 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:32.614070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632bd1d-a1ff-4095-89da-375104e8f062 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:32.615428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 753/1491] 10.222.0.45 () {54 vars in 926 bytes} [Fri Jun 3 09:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:51:32.620760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a38d40-3515-40e1-8f39-351287ee0816 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:32.621236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a38d40-3515-40e1-8f39-351287ee0816 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:32.621342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a38d40-3515-40e1-8f39-351287ee0816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:32.638897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-40a38d40-3515-40e1-8f39-351287ee0816 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:51:32.640079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-40a38d40-3515-40e1-8f39-351287ee0816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:51:32.647954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 739/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Jun 3 09:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:51:32.687540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632bd1d-a1ff-4095-89da-375104e8f062 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:51:32.697985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632bd1d-a1ff-4095-89da-375104e8f062 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:51:32.701427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc353d2-838e-4a64-9c92-d536f9fed342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:51:32.702091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc353d2-838e-4a64-9c92-d536f9fed342 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:51:32.702378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc353d2-838e-4a64-9c92-d536f9fed342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:51:32.702657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc353d2-838e-4a64-9c92-d536f9fed342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:51:32.711741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc353d2-838e-4a64-9c92-d536f9fed342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:51:32.713201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc353d2-838e-4a64-9c92-d536f9fed342 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:51:32.722897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 754/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:42.633679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=33 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:51:42.718254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=33 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:52:58.529476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31938-6712-4417-a329-d080cdb6c8e6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.530078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31938-6712-4417-a329-d080cdb6c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.530078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31938-6712-4417-a329-d080cdb6c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.547832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-80a31938-6712-4417-a329-d080cdb6c8e6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:52:58.549002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-80a31938-6712-4417-a329-d080cdb6c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:52:58.556596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 740/1494] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:52:58.564354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f33a5-f52b-46e4-b641-2da626a07b96 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.564812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f33a5-f52b-46e4-b641-2da626a07b96 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.564914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f33a5-f52b-46e4-b641-2da626a07b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.582513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e83f33a5-f52b-46e4-b641-2da626a07b96 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:52:58.583663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e83f33a5-f52b-46e4-b641-2da626a07b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:52:58.591202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 755/1495] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:52:58.596013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31938-6712-4417-a329-d080cdb6c8e6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:58.605374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31938-6712-4417-a329-d080cdb6c8e6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:58.609890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:58.610545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.610878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.611160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.611889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:52:58.612200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:58.613226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:58.613226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:52:58.613226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:52:58.614144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:58.625551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 741/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:52:58.633475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f33a5-f52b-46e4-b641-2da626a07b96 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:58.643083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f33a5-f52b-46e4-b641-2da626a07b96 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:58.647539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:58.648185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.648473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.648756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.649440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:58.651219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING py.warnings [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:58.651219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: warnings.warn(msg) Jun 03 09:52:58.651219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: Jun 03 09:52:58.652403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:58.689516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 756/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:52:58 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:52:58.693822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:58.704352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419bb6a-5ed4-4928-93db-95338ff7a22f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:58.759924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:58.760585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.760873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.761151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.761873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:58.762899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:58.762899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:52:58.762899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:52:58.764098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:58.783695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 742/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:52:58 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:52:58.787743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:58.797859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71325eeb-8e4b-46b0-ae71-d93c63025421 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:58.802558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:58.803213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.803503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.803785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.804513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:58.805529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING py.warnings [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:58.805529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: warnings.warn(msg) Jun 03 09:52:58.805529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: Jun 03 09:52:58.806462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:58.819471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 757/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:52:58.823357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:58.833681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c354-a590-47f9-bc04-d43f23d17fa9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:58.838263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d8928-7b66-4ec6-a897-ead89319c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:58.838946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d8928-7b66-4ec6-a897-ead89319c9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.839232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d8928-7b66-4ec6-a897-ead89319c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.839509 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d8928-7b66-4ec6-a897-ead89319c9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.840228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d8928-7b66-4ec6-a897-ead89319c9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:58.841244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-f99d8928-7b66-4ec6-a897-ead89319c9fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:58.841244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:52:58.841244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:52:58.842160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d8928-7b66-4ec6-a897-ead89319c9fd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:58.855290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 743/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:52:58.859086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:58.868653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868eb20a-a2ca-4e65-971f-5aae06bcadc2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:58.873226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366144-a670-4d0a-b01f-136a696708db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:58.874123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366144-a670-4d0a-b01f-136a696708db admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.874414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366144-a670-4d0a-b01f-136a696708db admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.874696 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366144-a670-4d0a-b01f-136a696708db admin admin] PATH_INFO: `/v3/projects/50df8c77974449778890a630ff75f357/users/5e47b296d8d247bdb7c9c971ca190c01/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.890212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366144-a670-4d0a-b01f-136a696708db admin admin] RBAC: Authorizing `identity:create_grant(project_id=50df8c77974449778890a630ff75f357, user_id=5e47b296d8d247bdb7c9c971ca190c01, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:58.891862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING py.warnings [None req-1d366144-a670-4d0a-b01f-136a696708db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:58.891862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: warnings.warn(msg) Jun 03 09:52:58.891862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: Jun 03 09:52:58.893842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366144-a670-4d0a-b01f-136a696708db admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:58.907014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 758/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:52:58 2022] PUT /identity/v3/projects/50df8c77974449778890a630ff75f357/users/5e47b296d8d247bdb7c9c971ca190c01/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:52:58.918792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c113-2cbf-491d-bebf-b8f8cb60df28 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:58.919085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c113-2cbf-491d-bebf-b8f8cb60df28 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:58.919365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c113-2cbf-491d-bebf-b8f8cb60df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:58.944630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-33e3c113-2cbf-491d-bebf-b8f8cb60df28 None None] MFA Rules not processed for user `5e47b296d8d247bdb7c9c971ca190c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:52:58.945835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-33e3c113-2cbf-491d-bebf-b8f8cb60df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:52:59.006345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 744/1502] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:52:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:52:59.019709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7ae3-08c0-42b5-a73b-0cbcb1679a93 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.020002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7ae3-08c0-42b5-a73b-0cbcb1679a93 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.020284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7ae3-08c0-42b5-a73b-0cbcb1679a93 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.021649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 759/1503] 10.222.0.45 () {54 vars in 963 bytes} [Fri Jun 3 09:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:52:59.026587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef48d48-0969-4328-bf6b-a4ea7f18aa72 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.026887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef48d48-0969-4328-bf6b-a4ea7f18aa72 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.027178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef48d48-0969-4328-bf6b-a4ea7f18aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.044766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8ef48d48-0969-4328-bf6b-a4ea7f18aa72 None None] MFA Rules not processed for user `795a9ecb4cd8448f81adbe68fdf967b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:52:59.045983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8ef48d48-0969-4328-bf6b-a4ea7f18aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:52:59.088449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:52:59.096402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 745/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Fri Jun 3 09:52:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:52:59.104047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7ae3-08c0-42b5-a73b-0cbcb1679a93 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:59.115073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7ae3-08c0-42b5-a73b-0cbcb1679a93 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:59.118583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:59.119206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.119492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.119769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.128358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:59.129797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:59.138374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 760/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:52:59.179118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e0797-df8c-4c2b-8b56-8d4ab7012a28 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.179415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e0797-df8c-4c2b-8b56-8d4ab7012a28 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.179702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e0797-df8c-4c2b-8b56-8d4ab7012a28 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.180985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 746/1506] 10.222.0.45 () {52 vars in 829 bytes} [Fri Jun 3 09:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:52:59.184709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:59.248227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bae21-c8a4-475e-88a4-1a755a812a58 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:59.253418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:59.254338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.254628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.254911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] PATH_INFO: `/v3/users/5e47b296d8d247bdb7c9c971ca190c01` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.256087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e47b296d8d247bdb7c9c971ca190c01)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:59.257141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING py.warnings [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:59.257141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: warnings.warn(msg) Jun 03 09:52:59.257141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: Jun 03 09:52:59.258385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:59.322115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e47b296d8d247bdb7c9c971ca190c01'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:52:59.334162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e47b296d8d247bdb7c9c971ca190c01'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:52:59.334917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e47b296d8d247bdb7c9c971ca190c01'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:52:59.343835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e47b296d8d247bdb7c9c971ca190c01'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:52:59.344470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e47b296d8d247bdb7c9c971ca190c01'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:52:59.360968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:52:59.369449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 761/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:52:59 2022] DELETE /identity/v3/users/5e47b296d8d247bdb7c9c971ca190c01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:52:59.373926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.374226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.374540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.392620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:52:59.393855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:52:59.451002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 747/1508] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:52:59.461245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:59.462647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:52:59.519074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b894a-1930-4715-b651-02295373f852 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:59.522651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420f3ab-6873-445e-a113-5a5d667336f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:59.523325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420f3ab-6873-445e-a113-5a5d667336f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.523613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420f3ab-6873-445e-a113-5a5d667336f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.523893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420f3ab-6873-445e-a113-5a5d667336f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.533462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420f3ab-6873-445e-a113-5a5d667336f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:59.534932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420f3ab-6873-445e-a113-5a5d667336f7 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:59.544251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 762/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:52:59.907627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:52:59.909680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:52:59.921446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbed87-8da3-4546-b5dd-7994e2626ca1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:52:59.926210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:52:59.927076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:52:59.927362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:52:59.927638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] PATH_INFO: `/v3/projects/50df8c77974449778890a630ff75f357` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:52:59.928907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50df8c77974449778890a630ff75f357)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:52:59.929871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:52:59.929871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:52:59.929871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:52:59.931058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:52:59.990057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50df8c77974449778890a630ff75f357', 'request_id': 'req-93e62e1e-1cf7-4a62-919e-04f98c17ec38'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:53:00.003224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50df8c77974449778890a630ff75f357', 'request_id': 'req-93e62e1e-1cf7-4a62-919e-04f98c17ec38'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:53:00.009194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50df8c77974449778890a630ff75f357', 'request_id': 'req-93e62e1e-1cf7-4a62-919e-04f98c17ec38'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:53:00.023383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] The token cache is being invalidate because project 50df8c77974449778890a630ff75f357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:53:00.023671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:53:00.024388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-93e62e1e-1cf7-4a62-919e-04f98c17ec38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:53:00.026136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 748/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:52:59 2022] DELETE /identity/v3/projects/50df8c77974449778890a630ff75f357 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:53:09.540094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:53:10.020477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:54:37.051738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf48a-2676-4d54-b9a2-b3a220ac5892 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:37.052248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf48a-2676-4d54-b9a2-b3a220ac5892 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:37.052354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf48a-2676-4d54-b9a2-b3a220ac5892 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:37.053697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:54:37.058653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414bbc-4faf-431c-80ae-bf38d2b61bfe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:37.059098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414bbc-4faf-431c-80ae-bf38d2b61bfe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:37.059208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414bbc-4faf-431c-80ae-bf38d2b61bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:37.080299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9e414bbc-4faf-431c-80ae-bf38d2b61bfe None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:37.082115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9e414bbc-4faf-431c-80ae-bf38d2b61bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:37.140362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:54:37.307348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bf48a-2676-4d54-b9a2-b3a220ac5892 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:54:37.309057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c24bf48a-2676-4d54-b9a2-b3a220ac5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:37.382865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bf48a-2676-4d54-b9a2-b3a220ac5892 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:54:37.388300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0316d-1d28-431a-8519-db9aaf8a28f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:54:37.388946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0316d-1d28-431a-8519-db9aaf8a28f7 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:37.389226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0316d-1d28-431a-8519-db9aaf8a28f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:37.389507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0316d-1d28-431a-8519-db9aaf8a28f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:37.397779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0316d-1d28-431a-8519-db9aaf8a28f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:54:37.399372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0316d-1d28-431a-8519-db9aaf8a28f7 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:54:37.408804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 764/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:54:38.279786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8445b9a-9927-4783-9014-151176e50585 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:38.280343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8445b9a-9927-4783-9014-151176e50585 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:38.280448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8445b9a-9927-4783-9014-151176e50585 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:38.281796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:54:38.286642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a720-1565-4df4-89c1-954d21d977d7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:38.287085 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a720-1565-4df4-89c1-954d21d977d7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:38.287272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a720-1565-4df4-89c1-954d21d977d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:38.306060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c662a720-1565-4df4-89c1-954d21d977d7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:38.307576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c662a720-1565-4df4-89c1-954d21d977d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:38.316409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:54:38.475602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8445b9a-9927-4783-9014-151176e50585 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:54:38.490817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8445b9a-9927-4783-9014-151176e50585 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:54:38.496232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd5480-8e73-4ba4-80d3-d686eff9a545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:54:38.496876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd5480-8e73-4ba4-80d3-d686eff9a545 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:38.497163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd5480-8e73-4ba4-80d3-d686eff9a545 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:38.497439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd5480-8e73-4ba4-80d3-d686eff9a545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:38.505518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd5480-8e73-4ba4-80d3-d686eff9a545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:54:38.507144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd5480-8e73-4ba4-80d3-d686eff9a545 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:54:38.516611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 751/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:54:38.559650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083348b-d119-4de3-8a19-1adbe3ba1a86 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:38.559942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083348b-d119-4de3-8a19-1adbe3ba1a86 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:38.560226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083348b-d119-4de3-8a19-1adbe3ba1a86 None None] PATH_INFO: `/v3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:38.561597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 766/1517] 10.222.0.67 () {54 vars in 925 bytes} [Fri Jun 3 09:54:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:54:38.568524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc823-123a-46c1-a1e8-e66d79b0ff52 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:38.568823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc823-123a-46c1-a1e8-e66d79b0ff52 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:38.569136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc823-123a-46c1-a1e8-e66d79b0ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:38.588274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3c0cc823-123a-46c1-a1e8-e66d79b0ff52 None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:38.589504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c0cc823-123a-46c1-a1e8-e66d79b0ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:38.652769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 752/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Fri Jun 3 09:54:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:54:47.853375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfa338-d9ea-480f-8857-8830a3b444c6 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:47.853985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfa338-d9ea-480f-8857-8830a3b444c6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:47.853985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfa338-d9ea-480f-8857-8830a3b444c6 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:47.855316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 767/1519] 10.222.0.45 () {54 vars in 960 bytes} [Fri Jun 3 09:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:54:47.860136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9a40e-1c97-4060-a76d-5fc6604a9df7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:47.860538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9a40e-1c97-4060-a76d-5fc6604a9df7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:47.860696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9a40e-1c97-4060-a76d-5fc6604a9df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:47.879308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-62b9a40e-1c97-4060-a76d-5fc6604a9df7 None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:47.880480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-62b9a40e-1c97-4060-a76d-5fc6604a9df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:47.888936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 753/1520] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Jun 3 09:54:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:54:47.895929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfa338-d9ea-480f-8857-8830a3b444c6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:54:47.909287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfa338-d9ea-480f-8857-8830a3b444c6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:54:47.914159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb057191-84f6-43f1-a252-07d7f25ec200 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:54:47.914780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb057191-84f6-43f1-a252-07d7f25ec200 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:47.915066 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb057191-84f6-43f1-a252-07d7f25ec200 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:47.915341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb057191-84f6-43f1-a252-07d7f25ec200 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:47.923523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb057191-84f6-43f1-a252-07d7f25ec200 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:54:47.925635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb057191-84f6-43f1-a252-07d7f25ec200 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:54:47.935088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 768/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:54:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:54:49.800150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db5cf0-a54f-4aaf-add7-06313ee8936b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:49.800681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db5cf0-a54f-4aaf-add7-06313ee8936b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:49.800799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db5cf0-a54f-4aaf-add7-06313ee8936b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:49.802214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:54:49.806948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263976-8590-4cce-9034-632786db3b93 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:49.807357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263976-8590-4cce-9034-632786db3b93 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:49.807519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263976-8590-4cce-9034-632786db3b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:49.825079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b4263976-8590-4cce-9034-632786db3b93 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:49.826295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b4263976-8590-4cce-9034-632786db3b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:49.834232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:54:49.987764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db5cf0-a54f-4aaf-add7-06313ee8936b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:54:50.002132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db5cf0-a54f-4aaf-add7-06313ee8936b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:54:50.007371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1e169-69b9-49ee-a7b6-28543715a13c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:54:50.007998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e169-69b9-49ee-a7b6-28543715a13c service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:50.008280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e169-69b9-49ee-a7b6-28543715a13c service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:50.008553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e169-69b9-49ee-a7b6-28543715a13c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:50.016513 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1e169-69b9-49ee-a7b6-28543715a13c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:54:50.018616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1e169-69b9-49ee-a7b6-28543715a13c service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:54:50.027747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 755/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:54:50.897513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92057-fda7-49c0-a544-4f041990a602 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:50.898149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92057-fda7-49c0-a544-4f041990a602 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:50.898149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92057-fda7-49c0-a544-4f041990a602 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:50.899491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:54:50.904678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79378930-cc69-4b34-9721-f571c59bb51f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:50.905125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79378930-cc69-4b34-9721-f571c59bb51f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:50.905236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79378930-cc69-4b34-9721-f571c59bb51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:50.923129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-79378930-cc69-4b34-9721-f571c59bb51f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:50.924315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-79378930-cc69-4b34-9721-f571c59bb51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:50.931874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:54:51.081972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b92057-fda7-49c0-a544-4f041990a602 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:54:51.096974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b92057-fda7-49c0-a544-4f041990a602 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:54:51.102315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce56be-2514-4449-8af3-647fe45b7e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:54:51.102943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce56be-2514-4449-8af3-647fe45b7e98 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:51.103228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce56be-2514-4449-8af3-647fe45b7e98 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:51.103506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce56be-2514-4449-8af3-647fe45b7e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:51.111477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce56be-2514-4449-8af3-647fe45b7e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:54:51.113045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce56be-2514-4449-8af3-647fe45b7e98 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:54:51.122282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 771/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:54:55.322013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ad83f-2124-4660-ba96-ed1b939d1a92 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:55.322585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ad83f-2124-4660-ba96-ed1b939d1a92 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:55.322585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ad83f-2124-4660-ba96-ed1b939d1a92 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:55.323973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:54:55.329361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ab9e0-de22-4eca-9316-0ff641640a6d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:55.329804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ab9e0-de22-4eca-9316-0ff641640a6d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:55.329962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ab9e0-de22-4eca-9316-0ff641640a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:55.350689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a65ab9e0-de22-4eca-9316-0ff641640a6d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:55.351880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a65ab9e0-de22-4eca-9316-0ff641640a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:55.359563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:54:55.395618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ad83f-2124-4660-ba96-ed1b939d1a92 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:54:55.397333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0e0ad83f-2124-4660-ba96-ed1b939d1a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:55.453007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ad83f-2124-4660-ba96-ed1b939d1a92 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:54:55.457027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e0c6-6d4a-47da-aa75-8f1a04436eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:54:55.457659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e0c6-6d4a-47da-aa75-8f1a04436eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:55.457974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e0c6-6d4a-47da-aa75-8f1a04436eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:55.458253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e0c6-6d4a-47da-aa75-8f1a04436eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:55.467019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9e0c6-6d4a-47da-aa75-8f1a04436eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:54:55.468445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9e0c6-6d4a-47da-aa75-8f1a04436eb3 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:54:55.473821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:54:55.478777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 758/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:54:57.708709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79715-998d-490c-ad68-e2d8f31df472 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:57.709260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79715-998d-490c-ad68-e2d8f31df472 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:57.709260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79715-998d-490c-ad68-e2d8f31df472 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:57.710695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:54:57.716179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b9578-18e1-4876-b9e4-dc5fff675ce3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:57.716599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b9578-18e1-4876-b9e4-dc5fff675ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:57.716804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b9578-18e1-4876-b9e4-dc5fff675ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:57.734710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1f7b9578-18e1-4876-b9e4-dc5fff675ce3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:54:57.735897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f7b9578-18e1-4876-b9e4-dc5fff675ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:54:57.744145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:54:57.780053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79715-998d-490c-ad68-e2d8f31df472 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:54:57.790830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79715-998d-490c-ad68-e2d8f31df472 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:54:57.794474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c6d8c-a920-4494-93b5-458844b3d66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:54:57.795108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6d8c-a920-4494-93b5-458844b3d66a service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:54:57.795398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6d8c-a920-4494-93b5-458844b3d66a service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:54:57.795681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6d8c-a920-4494-93b5-458844b3d66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:54:57.804962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c6d8c-a920-4494-93b5-458844b3d66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:54:57.806423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c6d8c-a920-4494-93b5-458844b3d66a service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:54:57.816906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 774/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:55:01.465269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f75e-4a06-4088-9d09-8d85501239e8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:55:01.465828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f75e-4a06-4088-9d09-8d85501239e8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:55:01.465944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f75e-4a06-4088-9d09-8d85501239e8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:55:01.467268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:55:01.472660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783ddb-4691-4118-887a-15881dc17dbc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:55:01.473060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783ddb-4691-4118-887a-15881dc17dbc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:55:01.473234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783ddb-4691-4118-887a-15881dc17dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:55:01.479588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=62 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:55:01.492076 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cf783ddb-4691-4118-887a-15881dc17dbc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:55:01.493262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cf783ddb-4691-4118-887a-15881dc17dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:55:01.501037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:55:01.771685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f75e-4a06-4088-9d09-8d85501239e8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:55:01.773362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6e11f75e-4a06-4088-9d09-8d85501239e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:55:01.836114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f75e-4a06-4088-9d09-8d85501239e8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:55:01.839620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9adc97-e723-4298-bff0-dc83b996573b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:55:01.840266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9adc97-e723-4298-bff0-dc83b996573b service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:55:01.840553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9adc97-e723-4298-bff0-dc83b996573b service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:55:01.840837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9adc97-e723-4298-bff0-dc83b996573b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:55:01.850240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9adc97-e723-4298-bff0-dc83b996573b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:55:01.851674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9adc97-e723-4298-bff0-dc83b996573b service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:55:01.860802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 761/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:55:04.119391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c29f-f9ed-4cfe-a65d-48dc200bc42a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:55:04.119917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c29f-f9ed-4cfe-a65d-48dc200bc42a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:55:04.120050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c29f-f9ed-4cfe-a65d-48dc200bc42a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:55:04.121330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:55:04.126576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715a40-246f-41b5-bf9f-8668aaa7ed04 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:55:04.126970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715a40-246f-41b5-bf9f-8668aaa7ed04 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:55:04.127649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715a40-246f-41b5-bf9f-8668aaa7ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:55:04.145877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ea715a40-246f-41b5-bf9f-8668aaa7ed04 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:55:04.147047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ea715a40-246f-41b5-bf9f-8668aaa7ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:55:04.154970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:55:04.421053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c29f-f9ed-4cfe-a65d-48dc200bc42a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:55:04.422738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dec7c29f-f9ed-4cfe-a65d-48dc200bc42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:55:04.435884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c29f-f9ed-4cfe-a65d-48dc200bc42a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:55:04.439361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08508a-b60b-469a-9d68-f317cc622222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:55:04.440628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08508a-b60b-469a-9d68-f317cc622222 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:55:04.440910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08508a-b60b-469a-9d68-f317cc622222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:55:04.441188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08508a-b60b-469a-9d68-f317cc622222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:55:04.449872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08508a-b60b-469a-9d68-f317cc622222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:55:04.451289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08508a-b60b-469a-9d68-f317cc622222 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:55:04.460459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 777/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:55:14.140043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=32 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:55:14.456398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:34.503632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5509e6-d414-4f13-ab52-e7cc1f03c440 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:34.504763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5509e6-d414-4f13-ab52-e7cc1f03c440 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:34.505288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5509e6-d414-4f13-ab52-e7cc1f03c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:34.549576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bd5509e6-d414-4f13-ab52-e7cc1f03c440 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:34.550822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bd5509e6-d414-4f13-ab52-e7cc1f03c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:34.562619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 763/1540] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:34.572394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a4f8-5bf0-4b94-94c2-35e19676d496 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:34.572998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a4f8-5bf0-4b94-94c2-35e19676d496 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:34.572998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a4f8-5bf0-4b94-94c2-35e19676d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:34.602518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3714a4f8-5bf0-4b94-94c2-35e19676d496 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:34.603847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3714a4f8-5bf0-4b94-94c2-35e19676d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:34.617494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 778/1541] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:34.622628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5509e6-d414-4f13-ab52-e7cc1f03c440 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:34.636686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5509e6-d414-4f13-ab52-e7cc1f03c440 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:34.655660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:34.656521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:34.656818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:34.657103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:34.657989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:34.658453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:34.660320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:34.683652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 764/1542] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:34.692912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a4f8-5bf0-4b94-94c2-35e19676d496 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:34.707512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a4f8-5bf0-4b94-94c2-35e19676d496 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:34.712596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:34.713523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:34.714069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:34.714578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:34.715650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:34.717833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:34.756375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 779/1543] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:34 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:34.761115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:34.773631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978439cd-d9ff-4067-8c63-a6dd98bcbd41 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:34.863954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:34.864654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:34.864943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:34.865226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:34.865962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:34.868507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:34.905159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 765/1544] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:34 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:34.909978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:34.923929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5321b-9d34-4600-91f2-16b6569d2c63 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:34.928989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:34.934062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:34.934618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:34.935120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:34.936081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:34.937967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:34.950619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 780/1545] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:34.955068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:34.966119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1452-864e-4200-a024-6d5bee701936 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:34.978301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cbb43-17d6-4935-99dd-378894f6f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:34.978981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbb43-17d6-4935-99dd-378894f6f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:34.979272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbb43-17d6-4935-99dd-378894f6f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:34.979555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbb43-17d6-4935-99dd-378894f6f9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:34.980287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cbb43-17d6-4935-99dd-378894f6f9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:34.981943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cbb43-17d6-4935-99dd-378894f6f9e5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.005327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 766/1546] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:35.009544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.029776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0b55c-bdb3-4034-b201-5ee047d1a067 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.035253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be705b-7d60-4132-9cad-2473f9f72845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.037601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be705b-7d60-4132-9cad-2473f9f72845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.038155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be705b-7d60-4132-9cad-2473f9f72845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.038655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be705b-7d60-4132-9cad-2473f9f72845 admin admin] PATH_INFO: `/v3/projects/b96e7e1b09a04adbba3bd083328ecb71/users/d547e64bcf5d4799af6039df3c9a4ea6/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.066289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be705b-7d60-4132-9cad-2473f9f72845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96e7e1b09a04adbba3bd083328ecb71, user_id=d547e64bcf5d4799af6039df3c9a4ea6, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.069390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be705b-7d60-4132-9cad-2473f9f72845 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.094662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 781/1547] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:35 2022] PUT /identity/v3/projects/b96e7e1b09a04adbba3bd083328ecb71/users/d547e64bcf5d4799af6039df3c9a4ea6/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:35.096140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734d4e-5e94-4267-82a6-1f3b11d74f52 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.096438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734d4e-5e94-4267-82a6-1f3b11d74f52 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.096720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734d4e-5e94-4267-82a6-1f3b11d74f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.100789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc751e-3a85-42d0-97d4-e0b52bec8e15 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.101338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc751e-3a85-42d0-97d4-e0b52bec8e15 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.101891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc751e-3a85-42d0-97d4-e0b52bec8e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.131693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-88dc751e-3a85-42d0-97d4-e0b52bec8e15 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.133305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-88dc751e-3a85-42d0-97d4-e0b52bec8e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.134753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b5734d4e-5e94-4267-82a6-1f3b11d74f52 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.136168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5734d4e-5e94-4267-82a6-1f3b11d74f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.245910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 767/1548] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:35.253842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a6de8-4af6-47b4-9341-71b79959cc4e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.253842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a6de8-4af6-47b4-9341-71b79959cc4e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.253842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a6de8-4af6-47b4-9341-71b79959cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.273572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 782/1549] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:35.273815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b28a6de8-4af6-47b4-9341-71b79959cc4e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.275203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b28a6de8-4af6-47b4-9341-71b79959cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.275456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c38f1-8cd4-48fd-a7f7-9e01c320dee0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.275903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c38f1-8cd4-48fd-a7f7-9e01c320dee0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.276335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c38f1-8cd4-48fd-a7f7-9e01c320dee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.288603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 768/1550] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.290059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b5003-3fd3-4600-b669-2bc42cee18cd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.290355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b5003-3fd3-4600-b669-2bc42cee18cd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.290640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b5003-3fd3-4600-b669-2bc42cee18cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.299088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3c3c38f1-8cd4-48fd-a7f7-9e01c320dee0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.300297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3c3c38f1-8cd4-48fd-a7f7-9e01c320dee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.308164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 783/1551] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.308434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5c9b5003-3fd3-4600-b669-2bc42cee18cd None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.309375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924ecb-bb67-4795-8592-d6fec7c7e348 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.309670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924ecb-bb67-4795-8592-d6fec7c7e348 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.309819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5c9b5003-3fd3-4600-b669-2bc42cee18cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.309995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924ecb-bb67-4795-8592-d6fec7c7e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.318122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 769/1552] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.319222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd430fc-c4f3-4b2f-9719-e4570c7b2ec1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.319507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd430fc-c4f3-4b2f-9719-e4570c7b2ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.319785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd430fc-c4f3-4b2f-9719-e4570c7b2ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.335273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-25924ecb-bb67-4795-8592-d6fec7c7e348 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.336472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-25924ecb-bb67-4795-8592-d6fec7c7e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.336685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3cd430fc-c4f3-4b2f-9719-e4570c7b2ec1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.337849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3cd430fc-c4f3-4b2f-9719-e4570c7b2ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.344384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 784/1553] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.345601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 770/1554] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.345726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a10f1-147b-4023-8b62-19478170beef None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.345970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a10f1-147b-4023-8b62-19478170beef None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.346218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a10f1-147b-4023-8b62-19478170beef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.346334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd430fc-c4f3-4b2f-9719-e4570c7b2ec1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.364255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b81a10f1-147b-4023-8b62-19478170beef None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.365455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b81a10f1-147b-4023-8b62-19478170beef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.373295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 785/1555] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.374524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3c2b-abbe-4686-b196-1069bf38576e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.374830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3c2b-abbe-4686-b196-1069bf38576e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.375124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3c2b-abbe-4686-b196-1069bf38576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.392457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:35.397866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1c4b3c2b-abbe-4686-b196-1069bf38576e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.399072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1c4b3c2b-abbe-4686-b196-1069bf38576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.406130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd430fc-c4f3-4b2f-9719-e4570c7b2ec1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.407345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 786/1556] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.408601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8acb-04af-456b-bf97-5da859403302 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.408891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8acb-04af-456b-bf97-5da859403302 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.409172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8acb-04af-456b-bf97-5da859403302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.415788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045ac61-c6bb-4201-9291-815780df514a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.416438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045ac61-c6bb-4201-9291-815780df514a service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.416722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045ac61-c6bb-4201-9291-815780df514a service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.417005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045ac61-c6bb-4201-9291-815780df514a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.426492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045ac61-c6bb-4201-9291-815780df514a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.427921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045ac61-c6bb-4201-9291-815780df514a service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.429410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-502f8acb-04af-456b-bf97-5da859403302 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.430605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-502f8acb-04af-456b-bf97-5da859403302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.437257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 771/1557] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:35.438496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 787/1558] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.438613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81f0ae-204e-49f3-9670-957785a7ecbe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.443062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81f0ae-204e-49f3-9670-957785a7ecbe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.443062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81f0ae-204e-49f3-9670-957785a7ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.443306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbd99b-fce5-4fcb-a31f-df4535580800 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.443306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbd99b-fce5-4fcb-a31f-df4535580800 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.443306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbd99b-fce5-4fcb-a31f-df4535580800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.460575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e3bbd99b-fce5-4fcb-a31f-df4535580800 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.461793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e3bbd99b-fce5-4fcb-a31f-df4535580800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.471914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 788/1559] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.472066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-db81f0ae-204e-49f3-9670-957785a7ecbe None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.473066 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbd99b-fce5-4fcb-a31f-df4535580800 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.474085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-db81f0ae-204e-49f3-9670-957785a7ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.491128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 772/1560] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.491275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbd99b-fce5-4fcb-a31f-df4535580800 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.491400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee9e-94bb-4237-984c-a71a50dc5076 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.491400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee9e-94bb-4237-984c-a71a50dc5076 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.491400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee9e-94bb-4237-984c-a71a50dc5076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.496954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.497962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.498416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.498861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.500053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:35.500543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.502036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING py.warnings [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:35.502036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: warnings.warn(msg) Jun 03 09:56:35.502036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: Jun 03 09:56:35.503477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f41b1-9d08-43c0-bbb4-fa2dc200f767 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.519735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fe0bee9e-94bb-4237-984c-a71a50dc5076 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.521645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fe0bee9e-94bb-4237-984c-a71a50dc5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.530128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 789/1561] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:35.530128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd5c9c-ab15-4c77-9808-b03089b7e46a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.530128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd5c9c-ab15-4c77-9808-b03089b7e46a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.530128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd5c9c-ab15-4c77-9808-b03089b7e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.535896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 773/1562] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.538238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268590-e24c-481d-b8f0-e26523366310 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.538238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268590-e24c-481d-b8f0-e26523366310 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.538693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268590-e24c-481d-b8f0-e26523366310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.556061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5fcd5c9c-ab15-4c77-9808-b03089b7e46a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.557965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5fcd5c9c-ab15-4c77-9808-b03089b7e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.568464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fd268590-e24c-481d-b8f0-e26523366310 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:35.570526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fd268590-e24c-481d-b8f0-e26523366310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:35.571962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 790/1563] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.573276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd5c9c-ab15-4c77-9808-b03089b7e46a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.589079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd5c9c-ab15-4c77-9808-b03089b7e46a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.593374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 774/1564] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:35.593374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268590-e24c-481d-b8f0-e26523366310 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.598650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.599328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.599619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.599904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.600808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:35.601125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.601781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268590-e24c-481d-b8f0-e26523366310 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.602799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.610447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.612418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.613250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.613729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.615065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:35.615702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.617552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.618529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 791/1565] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:35.619248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.629152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7e49a-97a6-43d9-8ee7-2c119f0d00b5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.631962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 775/1566] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:35.632932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.641137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.642026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.642314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.642592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.643505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:35.643911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.645791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.649334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220364c-a17f-48ac-adcb-f468fd40d745 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.654071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.654761 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.655307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.655588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.656282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.657958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:35.657958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:56:35.657958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:56:35.659046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.660956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 792/1567] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:35.661737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.682227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a99c5f-5321-4262-abca-fc43c5de8199 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.689925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.690834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.691409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.691760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.692613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:35.693050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.694750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.700961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 776/1568] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:35.702209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.703584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:35.711278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 793/1569] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:35.712287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.723893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c914-0933-4173-9f23-2197f4eb93d5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.777364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac84dfc-896c-44a5-a41d-d28fa52f3d48 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.783318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.783993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.784352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.784543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.785271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:35.785584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.787254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.789342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.790363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.790821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.791255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.792135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:35.792611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.794406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.800000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 777/1570] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:35.801016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.809138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 794/1571] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:35.810251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.828934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bc48f-2bcd-4c7f-b97a-780c9aab5ef4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.831248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d5a5-0aa2-4064-981e-0f1c877a8805 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.834841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.835499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.835793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.836133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.837131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.839153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.839851 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.840832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.841191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.841549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.842388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.845815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.871654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 778/1572] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:35.872607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.881233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 795/1573] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:35.882461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:35.942276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b531-ba77-466b-ac77-d69d6cb242ac admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.947332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.948008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.948294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.948574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.950324 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.952307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.955838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd8d0-5dc5-4339-896e-2116527e6896 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:35.956001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:35.969464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:35.971189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:35.971650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:35.971948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:35.974709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:35.976424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING py.warnings [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:35.976424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: warnings.warn(msg) Jun 03 09:56:35.976424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: Jun 03 09:56:35.978169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:35.989175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 779/1574] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:35.993374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.006173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 796/1575] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.010548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.022176 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d9436-a9a1-480a-ada3-6afd02cb5e77 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.060411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d80fbc-3bb8-4573-bd83-d0c7c5806dee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.066941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.067834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.068283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.068567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.069687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.072269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.088606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.089383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.089682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.090006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.090958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.093112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.096864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:36.107792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 780/1576] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:35 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.107792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.129005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 797/1577] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.129005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.183405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c2652-ab69-4a29-b488-97372a5a7885 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.197568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d288b6f-a3ea-42d0-a297-146bfb720af5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.205489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.206226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.206518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.206852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.207572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.210232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.236502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 798/1578] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.236502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.244578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709237b6-aba9-4f05-a45c-019eb0ef4a83 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.250052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.250669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.250959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.251771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.252482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.252671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.253476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.253868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.254222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.254470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.255101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.257137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.280459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 799/1579] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.281292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.295120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 781/1580] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.295120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.295444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2aca5-9341-4acd-be94-295d2b165077 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.301345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:36.365043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.365795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.366120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.366403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.367245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.369533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.373030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc45f-ec99-430d-aad4-745822170eda admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.382170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.382889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.383222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.383646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.384360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.386809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.403521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 800/1581] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.403521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.403791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 782/1582] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.403791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.416504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0d805-809a-4b3e-bb53-5aa4a7cdbf65 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.421614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.422340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.422634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.422939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.424311 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.426309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.439257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65c61-8421-4b44-9f6b-bd16ba7f85e7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.449477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.450155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.450477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.450725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.451428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.453377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.457152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 783/1583] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/users => generated 286 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.458136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.472507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ec9a-27f7-4dce-a0ee-cdcf14ffa9a6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.478109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.478941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.479236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.479524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.480435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.482429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.488829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 801/1584] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.490226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.503044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 784/1585] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.503044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.506182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53b3a3-8e10-4371-b7bf-20d4bfc5e12b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.514212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.515181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.515820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.516248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.517044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b19c4-21a8-40a3-9832-717788117d86 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.517495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.520153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.523704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.524503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.524884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.525258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.526427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.528534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.535019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 802/1586] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.535019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.554391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78357-edc4-4fdd-9109-fc3c80b26556 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.564266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 785/1587] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:36 2022] POST /identity/v3/users => generated 302 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:36.564266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.569887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.571152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.571613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.572025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.573182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.575317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.582660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17462e-3e76-47f5-85b6-f1b6a45f19dd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.591852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 803/1588] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.591852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.593959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.594832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.595857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.596476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.597510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.601406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.604463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bb6a-93da-4c17-ac5c-049a289731cd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.611214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678646d-7364-4665-a842-381a2828797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.612322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678646d-7364-4665-a842-381a2828797b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.614064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678646d-7364-4665-a842-381a2828797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.614492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678646d-7364-4665-a842-381a2828797b admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.615366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678646d-7364-4665-a842-381a2828797b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.617122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678646d-7364-4665-a842-381a2828797b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.618112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 786/1589] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.619041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:36.619681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.632555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 804/1590] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.633201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212371d-465b-4635-b0fe-024086147012 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.633879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678646d-7364-4665-a842-381a2828797b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.640145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.642288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.642805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.643373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.644633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.646533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.647101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678646d-7364-4665-a842-381a2828797b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.652949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.653925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.654422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.655098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.655931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.657721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.663226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 787/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.664772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.672943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 805/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.672943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.685540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1297-8134-418c-a183-96c47a92c1d9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.688099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8295fb-29de-4438-80be-f0d8cb100b43 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.691023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.691794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.692177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.692550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.693544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.695297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.698595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.699390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.699772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.700161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.700980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.702882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.717921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 806/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.717921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.718343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 788/1594] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.718343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.731207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178807a3-a933-401c-b660-f15512cf6a8c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.736855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.737572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2440fff-ad52-4c24-be0a-9ce55139a4cc admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.737773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.738074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.738357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] PATH_INFO: `/v3/projects/12d4ca628b894615bc311c3705c4a801/users/e62d9d781281497e9927c0eb0e85dd75/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.745365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.746193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.746561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.746966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.747912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.750491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.755535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d4ca628b894615bc311c3705c4a801, user_id=e62d9d781281497e9927c0eb0e85dd75, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.756706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:36.756706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:56:36.756706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:56:36.758675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.764646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 807/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.765821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.776978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 789/1596] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:36 2022] PUT /identity/v3/projects/12d4ca628b894615bc311c3705c4a801/users/e62d9d781281497e9927c0eb0e85dd75/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:36.780753 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003483-f9fe-4af7-9ffc-f8259b5c2ff6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.781641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.857064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.857742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.858051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.858329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.859057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.861200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.862071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:36.871637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1dc3c-6563-4933-8f62-a7d92ac0cf37 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.873907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 808/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.875184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.882809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.883520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.883832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.884109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.885201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.886932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.888083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e26fe-231e-41cf-886d-ddbc7e56c5ca admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.893672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.894615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.894900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.895177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] PATH_INFO: `/v3/projects/a937f473cd1b44bc8d628c7cadb18856/users/c216711b9e9b45f09f4917fe7b8275ab/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.909933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 790/1598] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.911999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.914136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a937f473cd1b44bc8d628c7cadb18856, user_id=c216711b9e9b45f09f4917fe7b8275ab, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.918299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.927773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79dee-0762-4050-b97d-4f179d5d8b45 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:36.934270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:36.934965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:36.935258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:36.935591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:36.940173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 809/1599] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:36 2022] PUT /identity/v3/projects/a937f473cd1b44bc8d628c7cadb18856/users/c216711b9e9b45f09f4917fe7b8275ab/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:36.940338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:36.940456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.940545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:36.954886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 791/1600] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:36.956182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:36.974383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ac94f-28f8-43ef-bb11-f415070678eb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.040653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de3ca2-c549-49e9-a1b8-1eed4598f466 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.047177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7ed0b-3f57-4587-89b1-7a57574cca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.048523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7ed0b-3f57-4587-89b1-7a57574cca89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.048523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7ed0b-3f57-4587-89b1-7a57574cca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.048771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7ed0b-3f57-4587-89b1-7a57574cca89 admin admin] PATH_INFO: `/v3/projects/0113e961aabb493a979359ef3a0125fc/users/473e9dc191f841949aadc6a13b1290ae/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.066174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7ed0b-3f57-4587-89b1-7a57574cca89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0113e961aabb493a979359ef3a0125fc, user_id=473e9dc191f841949aadc6a13b1290ae, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.069137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7ed0b-3f57-4587-89b1-7a57574cca89 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.076517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.077553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.078746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.078888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] PATH_INFO: `/v3/projects/433ca0cf7c0b4e159c1cc2bde0ceacf4/users/e626c5895fc948519bb83bc984dae125/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.085798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 810/1601] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:36 2022] PUT /identity/v3/projects/0113e961aabb493a979359ef3a0125fc/users/473e9dc191f841949aadc6a13b1290ae/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:37.087427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8d1d8-7868-472f-b616-399066e2fa9d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.087654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8d1d8-7868-472f-b616-399066e2fa9d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.087964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8d1d8-7868-472f-b616-399066e2fa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.100061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] RBAC: Authorizing `identity:create_grant(project_id=433ca0cf7c0b4e159c1cc2bde0ceacf4, user_id=e626c5895fc948519bb83bc984dae125, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.103495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.107621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-52c8d1d8-7868-472f-b616-399066e2fa9d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:37.109824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-52c8d1d8-7868-472f-b616-399066e2fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.141293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 792/1602] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:36 2022] PUT /identity/v3/projects/433ca0cf7c0b4e159c1cc2bde0ceacf4/users/e626c5895fc948519bb83bc984dae125/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:37.141293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:37.144125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:37.201890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 811/1603] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:37.202791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8d1d8-7868-472f-b616-399066e2fa9d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:37.208071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df424b41-0f6f-437d-a49d-7e3c1362684a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.213940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c513c-b586-4ec5-b5c5-b65a0562bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.215142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c513c-b586-4ec5-b5c5-b65a0562bb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.215467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c513c-b586-4ec5-b5c5-b65a0562bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.215746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c513c-b586-4ec5-b5c5-b65a0562bb2f admin admin] PATH_INFO: `/v3/projects/59c8ce3af6ab4503b0ec5a345a8618bc/users/e78c43e4248c4db681b29c1f630dfd72/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.215864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8d1d8-7868-472f-b616-399066e2fa9d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.221209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.222298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.222588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.222913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] PATH_INFO: `/v3/projects/ae18a142aa2049ffa07fc6516203f6fe/users/c2e257ae4e744dd8a0553b7c2abee529/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.232796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c513c-b586-4ec5-b5c5-b65a0562bb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c8ce3af6ab4503b0ec5a345a8618bc, user_id=e78c43e4248c4db681b29c1f630dfd72, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.235780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c513c-b586-4ec5-b5c5-b65a0562bb2f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.242390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae18a142aa2049ffa07fc6516203f6fe, user_id=c2e257ae4e744dd8a0553b7c2abee529, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.246096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.254307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 793/1604] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:37 2022] PUT /identity/v3/projects/59c8ce3af6ab4503b0ec5a345a8618bc/users/e78c43e4248c4db681b29c1f630dfd72/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:37.256774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cdeca-5756-40a1-9268-82518dbacf48 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.257066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cdeca-5756-40a1-9268-82518dbacf48 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.257352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cdeca-5756-40a1-9268-82518dbacf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.280171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 812/1605] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:37 2022] PUT /identity/v3/projects/ae18a142aa2049ffa07fc6516203f6fe/users/c2e257ae4e744dd8a0553b7c2abee529/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:37.280171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:37.287759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fe5cdeca-5756-40a1-9268-82518dbacf48 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:37.288964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fe5cdeca-5756-40a1-9268-82518dbacf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.343802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:37.365560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 794/1606] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:37.367320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102321-846a-4535-937d-6677f6b6cbb0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.367634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102321-846a-4535-937d-6677f6b6cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.367921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102321-846a-4535-937d-6677f6b6cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.382436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe10fc-aafd-421b-8f68-fac2ff4f7c19 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.397951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef11e6-919e-4a11-9824-79ae82e033b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.398982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef11e6-919e-4a11-9824-79ae82e033b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.399375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef11e6-919e-4a11-9824-79ae82e033b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.399753 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef11e6-919e-4a11-9824-79ae82e033b7 admin admin] PATH_INFO: `/v3/projects/6a1baf52594a40cea7a3db5584412e93/users/5a11ea8c47e54dc3a085689fe687690d/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.415601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e7102321-846a-4535-937d-6677f6b6cbb0 None None] MFA Rules not processed for user `473e9dc191f841949aadc6a13b1290ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:37.417096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e7102321-846a-4535-937d-6677f6b6cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.428920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef11e6-919e-4a11-9824-79ae82e033b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1baf52594a40cea7a3db5584412e93, user_id=5a11ea8c47e54dc3a085689fe687690d, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.432268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef11e6-919e-4a11-9824-79ae82e033b7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.465907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 813/1607] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:37 2022] PUT /identity/v3/projects/6a1baf52594a40cea7a3db5584412e93/users/5a11ea8c47e54dc3a085689fe687690d/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:37.468615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923259-3129-496f-ac77-f28dda2fc665 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.469483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923259-3129-496f-ac77-f28dda2fc665 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.470082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923259-3129-496f-ac77-f28dda2fc665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.498310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 795/1608] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:37.502553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7102321-846a-4535-937d-6677f6b6cbb0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:37.508130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cb923259-3129-496f-ac77-f28dda2fc665 None None] MFA Rules not processed for user `e626c5895fc948519bb83bc984dae125`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:37.509776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cb923259-3129-496f-ac77-f28dda2fc665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.622171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7102321-846a-4535-937d-6677f6b6cbb0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.666456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 814/1609] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:37.666456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2af1-e2aa-41c8-85b7-d44550372833 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.666456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2af1-e2aa-41c8-85b7-d44550372833 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.666456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2af1-e2aa-41c8-85b7-d44550372833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.677469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:37.694578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-153d2af1-e2aa-41c8-85b7-d44550372833 None None] MFA Rules not processed for user `e78c43e4248c4db681b29c1f630dfd72`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:37.696007 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-153d2af1-e2aa-41c8-85b7-d44550372833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.702652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.703329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.703606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.703883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.756435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:37.773903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 815/1610] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:37.775406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa27f5-fd2e-4021-9ac9-3f95e16f66cf None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.775700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa27f5-fd2e-4021-9ac9-3f95e16f66cf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.775987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa27f5-fd2e-4021-9ac9-3f95e16f66cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.778260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.779730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.790811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 796/1611] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:37.791517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:37.794062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.796338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-68fa27f5-fd2e-4021-9ac9-3f95e16f66cf None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:37.797566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-68fa27f5-fd2e-4021-9ac9-3f95e16f66cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.804306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043eb5d-1e36-4f2a-84da-847979df86d9 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.806973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 816/1612] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:37.807997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d58d8c-7070-455a-ab1d-bd7e3e7e1123 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.808291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d58d8c-7070-455a-ab1d-bd7e3e7e1123 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.808571 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d58d8c-7070-455a-ab1d-bd7e3e7e1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.811661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffe836-e648-4e8e-b508-b6763c0967c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.812319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe836-e648-4e8e-b508-b6763c0967c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.812638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe836-e648-4e8e-b508-b6763c0967c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.812878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe836-e648-4e8e-b508-b6763c0967c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.824245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffe836-e648-4e8e-b508-b6763c0967c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.825690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffe836-e648-4e8e-b508-b6763c0967c3 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.836223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 797/1613] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:37.837292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce0637-a982-436c-8bb7-7eb460e46522 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.837788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce0637-a982-436c-8bb7-7eb460e46522 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.837979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce0637-a982-436c-8bb7-7eb460e46522 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.839363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 798/1614] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 3 09:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:56:37.839906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce0637-a982-436c-8bb7-7eb460e46522 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:37.854119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce0637-a982-436c-8bb7-7eb460e46522 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:37.860006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d1d58d8c-7070-455a-ab1d-bd7e3e7e1123 None None] MFA Rules not processed for user `5a11ea8c47e54dc3a085689fe687690d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:37.860213 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:37.860916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:37.861491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:37.861919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:37.862701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d1d58d8c-7070-455a-ab1d-bd7e3e7e1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:37.862841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:37.864703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:37.898621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 799/1615] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:37.899463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:37.995512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 817/1616] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:37.996842 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d58d8c-7070-455a-ab1d-bd7e3e7e1123 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.017214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d58d8c-7070-455a-ab1d-bd7e3e7e1123 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.022274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cad063-d2ff-4bc6-9bf9-86eeb2511846 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.035777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c556-f0ad-4556-b6ef-d90c2aeee6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.036446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c556-f0ad-4556-b6ef-d90c2aeee6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.036738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c556-f0ad-4556-b6ef-d90c2aeee6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.037025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c556-f0ad-4556-b6ef-d90c2aeee6f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.037731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0c556-f0ad-4556-b6ef-d90c2aeee6f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.043341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0c556-f0ad-4556-b6ef-d90c2aeee6f2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.098823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 800/1617] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:37 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:38.100819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bedef-1b2e-4077-a45d-c5f77ac8d1b6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.101420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bedef-1b2e-4077-a45d-c5f77ac8d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.101843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bedef-1b2e-4077-a45d-c5f77ac8d1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.135790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9c6bedef-1b2e-4077-a45d-c5f77ac8d1b6 None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:38.137206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9c6bedef-1b2e-4077-a45d-c5f77ac8d1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:38.144117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.144885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.145252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.145987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.159522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.161213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.179579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 818/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:38.180705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.196875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5abfc9-2e4c-47a2-99ab-0f8332fdfdd8 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.256179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:38.295781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 801/1619] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 3 09:56:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:38.306257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bedef-1b2e-4077-a45d-c5f77ac8d1b6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.370556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.371998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.373840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.374192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.378727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.381987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.407458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:38.428541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 819/1620] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:38 2022] POST /identity/v3/users => generated 307 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:38.429621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.445854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f661c-0b80-4107-afcf-54065e1eb8e1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.453159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.454276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.457036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.458229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.459216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.461607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.500936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bedef-1b2e-4077-a45d-c5f77ac8d1b6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.509027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 820/1621] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:38 2022] POST /identity/v3/users => generated 293 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:38.510203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.512334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.513648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.515754 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.516195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.519108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.525460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.543346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ebe4d-d29f-4442-a911-d1b5ff10c668 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.556147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.556816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.557129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.557399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.600410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 802/1622] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:38 2022] POST /identity/v3/projects => generated 405 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:38.601187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.733376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.736889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.772034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 821/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:38.800828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.823355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f4771-8374-4099-9e75-70e9f8806936 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.856592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959371d-40c6-4a3b-913e-b7b760382abf service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.857913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.858614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.858938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.859428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.861271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.873558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.880169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.880924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.881157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.881438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.882246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.883876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.910520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 822/1624] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:38.918326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.922759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 803/1625] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:38.924762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:38.937238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e18b-275c-464b-9959-a3e79e442aa8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.939660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de297b-2873-460f-a8e1-c3ab25c5d6a7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:38.946455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.947861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.948341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.948778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] PATH_INFO: `/v3/projects/87223c3677384735b2d22e24fc27964b/users/c0242a8af6cd4b7386521bfc5197b953/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.955746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:38.956478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:38.956852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:38.957139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:38.957877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.959860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.970381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87223c3677384735b2d22e24fc27964b, user_id=c0242a8af6cd4b7386521bfc5197b953, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:38.976749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:38.998740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 823/1626] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:38 2022] POST /identity/v3/users => generated 309 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:38.999652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.012587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 804/1627] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:38 2022] PUT /identity/v3/projects/87223c3677384735b2d22e24fc27964b/users/c0242a8af6cd4b7386521bfc5197b953/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:39.020516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.023569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03a5f2-d436-41c8-8b45-bb8a316aa205 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.148191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121a5b8-fbb3-44d8-8d28-f544f3c35a8a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.177202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.179435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.180341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.180638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.181391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.184845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.191332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.192260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.192557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.192840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] PATH_INFO: `/v3/projects/cfccd879bc1d415582d64a8d54dd9990/users/d2e7870bd46e4294bbc1b26916bf4ea6/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.203023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:39.217693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfccd879bc1d415582d64a8d54dd9990, user_id=d2e7870bd46e4294bbc1b26916bf4ea6, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.220510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.230264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 805/1628] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:39.230264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.247768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 824/1629] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:38 2022] PUT /identity/v3/projects/cfccd879bc1d415582d64a8d54dd9990/users/d2e7870bd46e4294bbc1b26916bf4ea6/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:39.248820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.254243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bd687-c56f-481c-bc81-7a4cc29442f2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.294810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:39.369557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b47b-49f6-483b-91f3-04d880f5ae55 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.376049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.376968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.377208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.377543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] PATH_INFO: `/v3/projects/afdbb084aa9b45868f6f7619f381c8d4/users/1cee0af56f274200a8e2a409600c3492/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.411929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdbb084aa9b45868f6f7619f381c8d4, user_id=1cee0af56f274200a8e2a409600c3492, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.415310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.428093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fce89-e0ad-4abe-9fb2-5f0498355239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.428974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fce89-e0ad-4abe-9fb2-5f0498355239 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.429268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fce89-e0ad-4abe-9fb2-5f0498355239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.429774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fce89-e0ad-4abe-9fb2-5f0498355239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.430727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fce89-e0ad-4abe-9fb2-5f0498355239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.447160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 825/1630] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:39 2022] PUT /identity/v3/projects/afdbb084aa9b45868f6f7619f381c8d4/users/1cee0af56f274200a8e2a409600c3492/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:39.447376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fce89-e0ad-4abe-9fb2-5f0498355239 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.447764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.465336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 806/1631] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:39.467221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5375a6-a845-4849-84cf-738c9ce59b41 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.467520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5375a6-a845-4849-84cf-738c9ce59b41 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.467806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5375a6-a845-4849-84cf-738c9ce59b41 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.469642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 807/1632] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 3 09:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:56:39.471615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5375a6-a845-4849-84cf-738c9ce59b41 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.592688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a261-4bb4-433a-ba35-c1ab6f170441 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.599083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5375a6-a845-4849-84cf-738c9ce59b41 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.605469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.605925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baf2c0-f3ad-4800-ad43-c466e9cfb8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.606344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.606817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.607111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.607302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baf2c0-f3ad-4800-ad43-c466e9cfb8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.607739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baf2c0-f3ad-4800-ad43-c466e9cfb8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.608181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baf2c0-f3ad-4800-ad43-c466e9cfb8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.608297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.609188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baf2c0-f3ad-4800-ad43-c466e9cfb8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.610353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.611305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baf2c0-f3ad-4800-ad43-c466e9cfb8f0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.625968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 808/1633] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:39.627207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.637101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 826/1634] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:39.643267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02990-62c6-4fb4-a386-b2e9e6816ef8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.643965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f646a4-3cb6-497e-9185-fd6f6c868bc7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.644449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f646a4-3cb6-497e-9185-fd6f6c868bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.644906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f646a4-3cb6-497e-9185-fd6f6c868bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.650708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.651734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.652074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.652358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] PATH_INFO: `/v3/projects/87223c3677384735b2d22e24fc27964b/users/c0242a8af6cd4b7386521bfc5197b953/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.655390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87223c3677384735b2d22e24fc27964b, user_id=c0242a8af6cd4b7386521bfc5197b953, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.658534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.693904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 809/1635] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:39 2022] PUT /identity/v3/projects/87223c3677384735b2d22e24fc27964b/users/c0242a8af6cd4b7386521bfc5197b953/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:39.694938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.704826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-66f646a4-3cb6-497e-9185-fd6f6c868bc7 None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:39.714133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66f646a4-3cb6-497e-9185-fd6f6c868bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:39.831431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:39.866914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 827/1636] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:56:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:39.868528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f646a4-3cb6-497e-9185-fd6f6c868bc7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:39.897259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be3f1-4943-44d0-82e8-4929ea615c48 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.903540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f646a4-3cb6-497e-9185-fd6f6c868bc7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:39.913705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.916915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.919541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4dad9-8c4b-4c37-bcaa-697627d76213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:39.920709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4dad9-8c4b-4c37-bcaa-697627d76213 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.921104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4dad9-8c4b-4c37-bcaa-697627d76213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.921532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4dad9-8c4b-4c37-bcaa-697627d76213 admin admin] PATH_INFO: `/v3/projects/cfccd879bc1d415582d64a8d54dd9990/users/d2e7870bd46e4294bbc1b26916bf4ea6/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.926416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4dad9-8c4b-4c37-bcaa-697627d76213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfccd879bc1d415582d64a8d54dd9990, user_id=d2e7870bd46e4294bbc1b26916bf4ea6, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.929388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4dad9-8c4b-4c37-bcaa-697627d76213 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.929519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.929853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] PATH_INFO: `/v3/projects/afdbb084aa9b45868f6f7619f381c8d4/users/1cee0af56f274200a8e2a409600c3492/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:39.947058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdbb084aa9b45868f6f7619f381c8d4, user_id=1cee0af56f274200a8e2a409600c3492, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:39.960361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:39.970572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 828/1637] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:39 2022] PUT /identity/v3/projects/cfccd879bc1d415582d64a8d54dd9990/users/d2e7870bd46e4294bbc1b26916bf4ea6/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:39.972042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0bc00-85ef-4086-a5eb-1e1eda5fa908 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:39.975217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0bc00-85ef-4086-a5eb-1e1eda5fa908 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:39.975565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0bc00-85ef-4086-a5eb-1e1eda5fa908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.042256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 810/1638] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:39 2022] PUT /identity/v3/projects/afdbb084aa9b45868f6f7619f381c8d4/users/1cee0af56f274200a8e2a409600c3492/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:40.043617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:40.117242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d3e0bc00-85ef-4086-a5eb-1e1eda5fa908 None None] MFA Rules not processed for user `c0242a8af6cd4b7386521bfc5197b953`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:40.121119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d3e0bc00-85ef-4086-a5eb-1e1eda5fa908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:40.156812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:40.213401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba1bb7-3fe9-4c58-aaa5-5382e7be5766 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:40.237176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb5ad-ca66-4c3a-bcef-18fc86193664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:40.238415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb5ad-ca66-4c3a-bcef-18fc86193664 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:40.239088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb5ad-ca66-4c3a-bcef-18fc86193664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:40.240941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb5ad-ca66-4c3a-bcef-18fc86193664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.310089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 829/1639] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:40.312384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605fde6-9ad6-4ff5-ada0-fde46b2284b3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:40.312384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605fde6-9ad6-4ff5-ada0-fde46b2284b3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:40.312384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605fde6-9ad6-4ff5-ada0-fde46b2284b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.398232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c605fde6-9ad6-4ff5-ada0-fde46b2284b3 None None] MFA Rules not processed for user `d2e7870bd46e4294bbc1b26916bf4ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:40.401365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c605fde6-9ad6-4ff5-ada0-fde46b2284b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:40.435897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deb5ad-ca66-4c3a-bcef-18fc86193664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:40.438072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deb5ad-ca66-4c3a-bcef-18fc86193664 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:40.467461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 811/1640] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:40.499606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a59d9-d020-4a9c-b0fd-7ed1353b6fa1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:40.503145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a59d9-d020-4a9c-b0fd-7ed1353b6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:40.503581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a59d9-d020-4a9c-b0fd-7ed1353b6fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.559054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 830/1641] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:40.560625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe4b5-9eb5-4a35-9f68-b39cf2b3113a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:40.568495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe4b5-9eb5-4a35-9f68-b39cf2b3113a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:40.568870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe4b5-9eb5-4a35-9f68-b39cf2b3113a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.573154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-805a59d9-d020-4a9c-b0fd-7ed1353b6fa1 None None] MFA Rules not processed for user `1cee0af56f274200a8e2a409600c3492`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:40.574648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-805a59d9-d020-4a9c-b0fd-7ed1353b6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:40.684565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-445fe4b5-9eb5-4a35-9f68-b39cf2b3113a None None] MFA Rules not processed for user `c2e257ae4e744dd8a0553b7c2abee529`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:40.685836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-445fe4b5-9eb5-4a35-9f68-b39cf2b3113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:40.706566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 812/1642] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:40.708020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a59d9-d020-4a9c-b0fd-7ed1353b6fa1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:40.745017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a59d9-d020-4a9c-b0fd-7ed1353b6fa1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:40.760330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83acd3-58f6-4e88-8e91-bfbf11f09146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:40.761621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83acd3-58f6-4e88-8e91-bfbf11f09146 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:40.762931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83acd3-58f6-4e88-8e91-bfbf11f09146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:40.763338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83acd3-58f6-4e88-8e91-bfbf11f09146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.793957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83acd3-58f6-4e88-8e91-bfbf11f09146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:40.797435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83acd3-58f6-4e88-8e91-bfbf11f09146 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:40.834367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 813/1643] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:40.859720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:40.901577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 831/1644] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:40.914978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5782-bd05-46f5-8614-be03a9a1c806 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:40.915530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5782-bd05-46f5-8614-be03a9a1c806 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:40.916347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5782-bd05-46f5-8614-be03a9a1c806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.950727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe4b5-9eb5-4a35-9f68-b39cf2b3113a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:40.950928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-417e5782-bd05-46f5-8614-be03a9a1c806 None None] MFA Rules not processed for user `c2e257ae4e744dd8a0553b7c2abee529`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:40.952090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-417e5782-bd05-46f5-8614-be03a9a1c806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:40.964680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe4b5-9eb5-4a35-9f68-b39cf2b3113a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:40.975542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 814/1645] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:40.978162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:40.979280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:40.979819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:40.980321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:40.993476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:40.995441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:41.007856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb51bfe-dcf3-4c04-8987-a5f949c056d4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:41.008062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb51bfe-dcf3-4c04-8987-a5f949c056d4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:41.008323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb51bfe-dcf3-4c04-8987-a5f949c056d4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:41.010409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 815/1646] 10.222.0.45 () {54 vars in 961 bytes} [Fri Jun 3 09:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:56:41.031226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 832/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:41.042496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5e325-f438-41e7-965f-2a440c2828fa None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:41.042774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5e325-f438-41e7-965f-2a440c2828fa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:41.043194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5e325-f438-41e7-965f-2a440c2828fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:41.076139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3ad5e325-f438-41e7-965f-2a440c2828fa None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:41.078485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3ad5e325-f438-41e7-965f-2a440c2828fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:41.110347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 816/1648] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Jun 3 09:56:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:41.130848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:41.141638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02911e43-9f44-40f9-ac46-255ca296bde4 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:41.144633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5e325-f438-41e7-965f-2a440c2828fa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:41.158864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5e325-f438-41e7-965f-2a440c2828fa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:41.163631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:41.164392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:41.164680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:41.164957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:41.167942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:41.169873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:41.170440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:41.170960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:41.186181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:41.188286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:41.191274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:41.191446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:41.224551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 817/1649] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:56:41.234492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 833/1650] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:41 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:41.577206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:41.603448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e9959-639c-463f-9a61-d9e67833810a service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:41.615207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653f3b3-17f3-4e05-9da1-91ba25a51bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:41.616249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653f3b3-17f3-4e05-9da1-91ba25a51bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:41.616720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653f3b3-17f3-4e05-9da1-91ba25a51bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:41.617190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653f3b3-17f3-4e05-9da1-91ba25a51bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:41.643236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:41.800104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:41.834955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee168f5e-5fa4-448c-87ff-e6c8e32007ab service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:41.853074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:41.854127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:41.854597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:41.855055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:41.863881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653f3b3-17f3-4e05-9da1-91ba25a51bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:41.866406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653f3b3-17f3-4e05-9da1-91ba25a51bf8 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:41.929332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 818/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:42.146006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba5d2-4158-402a-8a9c-95b2100343fc None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:42.146997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba5d2-4158-402a-8a9c-95b2100343fc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:42.146997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba5d2-4158-402a-8a9c-95b2100343fc None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:42.150094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 819/1652] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 3 09:56:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:56:42.158276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fafce-ee64-4fa0-b552-35b009e14201 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:42.158789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fafce-ee64-4fa0-b552-35b009e14201 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:42.159302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fafce-ee64-4fa0-b552-35b009e14201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:42.173770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:42.177724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:42.196071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 834/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:42.228528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1f8fafce-ee64-4fa0-b552-35b009e14201 None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:42.229049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f8fafce-ee64-4fa0-b552-35b009e14201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:42.273177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 820/1654] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:56:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:42.299559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:42.302183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:42.563516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361930-df0f-437a-aacc-6288abce2600 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:42.577110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede4e4b-a7a9-466d-90f5-5105dbb954de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:42.578209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4e4b-a7a9-466d-90f5-5105dbb954de service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:42.578715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4e4b-a7a9-466d-90f5-5105dbb954de service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:42.579723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4e4b-a7a9-466d-90f5-5105dbb954de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:42.646919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede4e4b-a7a9-466d-90f5-5105dbb954de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:42.649570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede4e4b-a7a9-466d-90f5-5105dbb954de service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:42.710431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 835/1655] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:43.091102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fafce-ee64-4fa0-b552-35b009e14201 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:43.269199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fafce-ee64-4fa0-b552-35b009e14201 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:43.291532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:43.316366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:43.316366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:43.316366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] PATH_INFO: `/v3/users/5a11ea8c47e54dc3a085689fe687690d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:43.316366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a11ea8c47e54dc3a085689fe687690d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:43.316366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: WARNING py.warnings [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:43.316366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: warnings.warn(msg) Jun 03 09:56:43.316366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: Jun 03 09:56:43.326233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:43.483183 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a11ea8c47e54dc3a085689fe687690d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:43.511482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a11ea8c47e54dc3a085689fe687690d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:43.512441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a11ea8c47e54dc3a085689fe687690d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:43.535515 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a11ea8c47e54dc3a085689fe687690d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:43.537552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a11ea8c47e54dc3a085689fe687690d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:43.620709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 821/1656] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:56:43 2022] DELETE /identity/v3/users/5a11ea8c47e54dc3a085689fe687690d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:43.622014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc8f7-ef43-4374-a2a1-60daf1f9a7ce None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:43.622498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc8f7-ef43-4374-a2a1-60daf1f9a7ce None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:43.622585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc8f7-ef43-4374-a2a1-60daf1f9a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:43.668019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-688bc8f7-ef43-4374-a2a1-60daf1f9a7ce None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:43.669260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-688bc8f7-ef43-4374-a2a1-60daf1f9a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:43.866647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:43.894989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 836/1657] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:43.977710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:43.979611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:44.133402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:44.242125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8b1b-17e0-4d35-9eb4-a0b5bdfb1570 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:44.252732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461c475-0af6-49d7-937a-09aeeb6b0782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:44.253601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461c475-0af6-49d7-937a-09aeeb6b0782 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:44.254049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461c475-0af6-49d7-937a-09aeeb6b0782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:44.254463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461c475-0af6-49d7-937a-09aeeb6b0782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:44.290135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461c475-0af6-49d7-937a-09aeeb6b0782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:44.292571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461c475-0af6-49d7-937a-09aeeb6b0782 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:44.325034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 822/1658] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:44.437687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6916d-4c2b-46f5-9ba4-aa348bb310cb None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:44.438290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6916d-4c2b-46f5-9ba4-aa348bb310cb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:44.439693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6916d-4c2b-46f5-9ba4-aa348bb310cb None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:44.442387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 837/1659] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 3 09:56:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:56:44.448720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:44.449015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:44.449390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:44.528990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] MFA Rules not processed for user `2585af8b95ea48d1a3576bd722536fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:44.530579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:44.547923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 823/1660] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:56:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:44.607489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6916d-4c2b-46f5-9ba4-aa348bb310cb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:44.609493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7ce6916d-4c2b-46f5-9ba4-aa348bb310cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:44.635281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6916d-4c2b-46f5-9ba4-aa348bb310cb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:44.649677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:44.650596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:44.652077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:44.652544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:44.671814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:44.673615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:44.684896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 838/1661] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:45.105128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:45.107445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:45.151533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5b2f1-280e-4650-b317-dac2c1bb5b6b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:45.166229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:45.167285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:45.167574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:45.167853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] PATH_INFO: `/v3/projects/6a1baf52594a40cea7a3db5584412e93` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:45.171797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1baf52594a40cea7a3db5584412e93)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:45.173839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:45.260834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1baf52594a40cea7a3db5584412e93', 'request_id': 'req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.278163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1baf52594a40cea7a3db5584412e93', 'request_id': 'req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.307352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1baf52594a40cea7a3db5584412e93', 'request_id': 'req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.364559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] The token cache is being invalidate because project 6a1baf52594a40cea7a3db5584412e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:56:45.364885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.368078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4366c27d-a1b1-4fd1-8f92-b0e38f93f70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.375238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 824/1662] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:56:45 2022] DELETE /identity/v3/projects/6a1baf52594a40cea7a3db5584412e93 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:45.380161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:45.401487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c48e4-469c-4467-b6b5-c20bc51bd11a service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:45.609163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:45.610103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:45.610909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:45.617779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] PATH_INFO: `/v3/users/1cee0af56f274200a8e2a409600c3492` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:45.622087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cee0af56f274200a8e2a409600c3492)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:45.633247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:45.778326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cee0af56f274200a8e2a409600c3492'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.804304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cee0af56f274200a8e2a409600c3492'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.805467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cee0af56f274200a8e2a409600c3492'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.830775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cee0af56f274200a8e2a409600c3492'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.831714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-203ba616-d4a0-47ea-9deb-db468bf8c7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cee0af56f274200a8e2a409600c3492'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:45.901397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 839/1663] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:56:45 2022] DELETE /identity/v3/users/1cee0af56f274200a8e2a409600c3492 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:46.071225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bc4f-a2ca-4d9a-83dd-3d9238bc9708 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:46.071478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bc4f-a2ca-4d9a-83dd-3d9238bc9708 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:46.071775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bc4f-a2ca-4d9a-83dd-3d9238bc9708 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:46.073288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 825/1664] 10.222.0.45 () {54 vars in 960 bytes} [Fri Jun 3 09:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:56:46.082458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:46.082745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:46.083210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:46.111969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:46.113210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:46.203890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 840/1665] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Jun 3 09:56:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:46.211712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191bc4f-a2ca-4d9a-83dd-3d9238bc9708 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:46.228157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191bc4f-a2ca-4d9a-83dd-3d9238bc9708 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:46.244880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980c254-d228-4ca1-b7c9-44e7d347b3ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:46.245717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980c254-d228-4ca1-b7c9-44e7d347b3ce service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:46.246191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980c254-d228-4ca1-b7c9-44e7d347b3ce service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:46.246759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980c254-d228-4ca1-b7c9-44e7d347b3ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:46.255280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f980c254-d228-4ca1-b7c9-44e7d347b3ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:46.290376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980c254-d228-4ca1-b7c9-44e7d347b3ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:46.296379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980c254-d228-4ca1-b7c9-44e7d347b3ce service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:46.340202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 826/1666] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:46.717441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:46.718894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:46.726966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:46.930318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf254c-8947-4c30-b1f8-a26ebd30cef7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:46.945126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:46.946072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:46.946365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:46.946645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] PATH_INFO: `/v3/projects/afdbb084aa9b45868f6f7619f381c8d4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:46.953592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afdbb084aa9b45868f6f7619f381c8d4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:46.954780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: WARNING py.warnings [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:46.954780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: warnings.warn(msg) Jun 03 09:56:46.954780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: Jun 03 09:56:46.956189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:47.076420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afdbb084aa9b45868f6f7619f381c8d4', 'request_id': 'req-bd748b89-f66c-4f85-b02e-baae09b63d94'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:47.090677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afdbb084aa9b45868f6f7619f381c8d4', 'request_id': 'req-bd748b89-f66c-4f85-b02e-baae09b63d94'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:47.102200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afdbb084aa9b45868f6f7619f381c8d4', 'request_id': 'req-bd748b89-f66c-4f85-b02e-baae09b63d94'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:47.127016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f26c7-bf79-496d-9b31-139179507416 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:47.127451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f26c7-bf79-496d-9b31-139179507416 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:47.127899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f26c7-bf79-496d-9b31-139179507416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:47.164965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] The token cache is being invalidate because project afdbb084aa9b45868f6f7619f381c8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:56:47.168407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:47.171292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd748b89-f66c-4f85-b02e-baae09b63d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:47.180241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 841/1667] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:56:46 2022] DELETE /identity/v3/projects/afdbb084aa9b45868f6f7619f381c8d4 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:47.186435 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758f9bb-a67c-4a91-9f49-5d916daea26c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:47.187086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758f9bb-a67c-4a91-9f49-5d916daea26c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:47.187668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758f9bb-a67c-4a91-9f49-5d916daea26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:47.210593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-024f26c7-bf79-496d-9b31-139179507416 None None] MFA Rules not processed for user `d547e64bcf5d4799af6039df3c9a4ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:47.212251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-024f26c7-bf79-496d-9b31-139179507416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:47.280367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7758f9bb-a67c-4a91-9f49-5d916daea26c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:47.285511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7758f9bb-a67c-4a91-9f49-5d916daea26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:47.464175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 827/1668] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:47.474030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:47.474328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:47.474603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:47.478087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 842/1669] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:47.486994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaf176-2e2f-486e-b2fb-0ddf5b7a9c27 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:47.488507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaf176-2e2f-486e-b2fb-0ddf5b7a9c27 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:47.488805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaf176-2e2f-486e-b2fb-0ddf5b7a9c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:47.521439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] MFA Rules not processed for user `d547e64bcf5d4799af6039df3c9a4ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:47.523117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:47.523976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-13aaf176-2e2f-486e-b2fb-0ddf5b7a9c27 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:47.525237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-13aaf176-2e2f-486e-b2fb-0ddf5b7a9c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:47.540809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 843/1670] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:47.546263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaf176-2e2f-486e-b2fb-0ddf5b7a9c27 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:47.546790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 828/1671] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:47.555896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:47.558739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:47.560055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaf176-2e2f-486e-b2fb-0ddf5b7a9c27 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:47.571075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:47.586112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:47.587107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:47.588007 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:47.588630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:47.589397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:47.589712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:47.591390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:47.653994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 844/1672] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:56:47.658639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:47.676064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e0d0-0ef5-4499-b1a7-61de14dee4a4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:47.682872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:47.683877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:47.684344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:47.684802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:47.689966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654249ff-dc0d-4b0a-b5db-b81db30808ef admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:47.697796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:47.700441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:47.702994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:47.703693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:47.706035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:47.706035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:47.706896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:47.713343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:47.733670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 829/1673] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:56:47.747076 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:47.811230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 845/1674] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:47 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:47.816143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:47.841884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f6b77-7285-4ce3-9e1c-5582618a4777 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:48.011327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:48.012005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.012291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.012570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.013263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:48.015286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:48.075554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 830/1675] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:47 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:48.078804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:48.104004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6a48d-e9b3-4517-80de-978aea2fee86 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:48.123413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:48.124048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.124400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.124694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.126978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:48.136101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:48.159177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 846/1676] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:48.160237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:48.178077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5fef1-0f19-4b6b-8fa5-e5737c6a08fc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:48.197404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c8338-06ee-4e04-a0d1-95c299210c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:48.204078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8338-06ee-4e04-a0d1-95c299210c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.204401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8338-06ee-4e04-a0d1-95c299210c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.207446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8338-06ee-4e04-a0d1-95c299210c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.208275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c8338-06ee-4e04-a0d1-95c299210c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:48.224125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c8338-06ee-4e04-a0d1-95c299210c4e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:48.251014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 831/1677] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:56:48.255030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:48.269532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abc531-3078-4a52-9a64-2ad7a4de311d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:48.289376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f63ff-cc1e-446f-aa2b-6d5fb5aee5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:48.290601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f63ff-cc1e-446f-aa2b-6d5fb5aee5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.291064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f63ff-cc1e-446f-aa2b-6d5fb5aee5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.291543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f63ff-cc1e-446f-aa2b-6d5fb5aee5f5 admin admin] PATH_INFO: `/v3/projects/c544913f779c448ca7f3931f571cb3cd/users/c097b58cf4d94a5bacb2c9db7cad47ab/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.334549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f63ff-cc1e-446f-aa2b-6d5fb5aee5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c544913f779c448ca7f3931f571cb3cd, user_id=c097b58cf4d94a5bacb2c9db7cad47ab, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:48.340582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f63ff-cc1e-446f-aa2b-6d5fb5aee5f5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:48.385996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 847/1678] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:48 2022] PUT /identity/v3/projects/c544913f779c448ca7f3931f571cb3cd/users/c097b58cf4d94a5bacb2c9db7cad47ab/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:48.386277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a080c7-04a8-4056-b5bb-7713624a2d02 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.386277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a080c7-04a8-4056-b5bb-7713624a2d02 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.386277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a080c7-04a8-4056-b5bb-7713624a2d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.398512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.398877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.399205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.436264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] MFA Rules not processed for user `c097b58cf4d94a5bacb2c9db7cad47ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:48.437501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:48.442988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-76a080c7-04a8-4056-b5bb-7713624a2d02 None None] MFA Rules not processed for user `c216711b9e9b45f09f4917fe7b8275ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:48.444416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-76a080c7-04a8-4056-b5bb-7713624a2d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:48.573431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:48.586671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 832/1679] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:48.648772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 848/1680] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:48.653341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a080c7-04a8-4056-b5bb-7713624a2d02 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:48.698002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:48.699717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:48.816648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a080c7-04a8-4056-b5bb-7713624a2d02 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:48.828597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:48.830676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.831498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.833064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.834666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:48.839329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:48.861228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85583472-fe08-4bf9-a1ec-207519221129 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:48.871462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:48.873813 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:48.874110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:48.874426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:48.895436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:48.902104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 833/1681] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:48 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:48.902276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:48.903495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:48.966829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 849/1682] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:49.126897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777dcdf-e5e5-49e5-abe7-3a8f5d5dfb77 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:49.136912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:49.139187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:49.139484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:49.141105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:49.143626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:49.148170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:49.222742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 834/1683] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:48 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:49.231577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:49.255020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3599-f7b9-47a3-852b-1e3b75460858 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:49.282533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:49.283604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:49.283902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:49.284187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:49.284924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:49.287890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:49.345893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 850/1684] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:49.346191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:49.373643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5901822-256b-454a-8608-b458933258e6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:49.403001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:49.406210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:49.407244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:49.409591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] PATH_INFO: `/v3/projects/79949cc0b7484d9aa4a94b93d5511fbd/users/df5a18f5181747d8b8f9d5e4af0bb24b/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:49.494174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79949cc0b7484d9aa4a94b93d5511fbd, user_id=df5a18f5181747d8b8f9d5e4af0bb24b, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:49.499650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:49.564479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 835/1685] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:49 2022] PUT /identity/v3/projects/79949cc0b7484d9aa4a94b93d5511fbd/users/df5a18f5181747d8b8f9d5e4af0bb24b/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:49.568352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:49.588537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcbc57-e7b9-4330-89c8-73a7f3c500e6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:49.643265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:49.797686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552fcc-b56d-4a99-8d2c-e5e8d58a1334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:49.805931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552fcc-b56d-4a99-8d2c-e5e8d58a1334 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:49.806339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552fcc-b56d-4a99-8d2c-e5e8d58a1334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:49.809161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552fcc-b56d-4a99-8d2c-e5e8d58a1334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:49.811097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13552fcc-b56d-4a99-8d2c-e5e8d58a1334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:49.812832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13552fcc-b56d-4a99-8d2c-e5e8d58a1334 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:49.870748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:49.872698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 851/1686] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:49.904890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944ab0-3b5c-4e8b-a54d-c67eb9f20596 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:49.927866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:49.929721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:49.930182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:49.934021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97131d-923d-41a3-bb0c-bd43810704a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:49.935904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97131d-923d-41a3-bb0c-bd43810704a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:49.935904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97131d-923d-41a3-bb0c-bd43810704a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:49.935904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97131d-923d-41a3-bb0c-bd43810704a2 admin admin] PATH_INFO: `/v3/projects/79949cc0b7484d9aa4a94b93d5511fbd/users/df5a18f5181747d8b8f9d5e4af0bb24b/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:49.939145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97131d-923d-41a3-bb0c-bd43810704a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79949cc0b7484d9aa4a94b93d5511fbd, user_id=df5a18f5181747d8b8f9d5e4af0bb24b, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:49.947812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97131d-923d-41a3-bb0c-bd43810704a2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:50.004211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 836/1687] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:49 2022] PUT /identity/v3/projects/79949cc0b7484d9aa4a94b93d5511fbd/users/df5a18f5181747d8b8f9d5e4af0bb24b/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:56:50.006451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc53833-5783-4320-a05c-6b674a6fbcad None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:50.006855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc53833-5783-4320-a05c-6b674a6fbcad None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:50.007241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc53833-5783-4320-a05c-6b674a6fbcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:50.008074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] MFA Rules not processed for user `d547e64bcf5d4799af6039df3c9a4ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:50.009776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:50.122757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3cc53833-5783-4320-a05c-6b674a6fbcad None None] MFA Rules not processed for user `df5a18f5181747d8b8f9d5e4af0bb24b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:50.124014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3cc53833-5783-4320-a05c-6b674a6fbcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:50.199926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:50.219219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 852/1688] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:50.348542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 837/1689] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:50.359906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:50.365793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:50.540049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5dd9-876a-4f4d-b2e3-e31c352071db None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:50.545527 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9372dc-dfe8-4166-852f-44663fd496d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:50.546636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9372dc-dfe8-4166-852f-44663fd496d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:50.547120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9372dc-dfe8-4166-852f-44663fd496d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:50.547585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9372dc-dfe8-4166-852f-44663fd496d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:50.576975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9372dc-dfe8-4166-852f-44663fd496d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:50.581506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9372dc-dfe8-4166-852f-44663fd496d7 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:50.615668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 853/1690] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:51.089383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d375-99b9-4f83-ac89-48bd79758217 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:51.089906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d375-99b9-4f83-ac89-48bd79758217 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:51.093386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d375-99b9-4f83-ac89-48bd79758217 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:51.096732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 838/1691] 10.222.0.45 () {54 vars in 912 bytes} [Fri Jun 3 09:56:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:56:51.103432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64f32d-584b-42bd-9f3d-34412f88d4b1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:51.103719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64f32d-584b-42bd-9f3d-34412f88d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:51.104003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64f32d-584b-42bd-9f3d-34412f88d4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:51.159033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1b64f32d-584b-42bd-9f3d-34412f88d4b1 None None] MFA Rules not processed for user `2585af8b95ea48d1a3576bd722536fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:51.163828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1b64f32d-584b-42bd-9f3d-34412f88d4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:51.368867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 854/1692] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:56:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:51.458758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649d375-99b9-4f83-ac89-48bd79758217 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:51.461048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a649d375-99b9-4f83-ac89-48bd79758217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:51.473136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64f32d-584b-42bd-9f3d-34412f88d4b1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:51.487056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649d375-99b9-4f83-ac89-48bd79758217 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:51.490991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:51.492026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:51.492376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:51.492713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:51.502968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:51.505008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:51.512475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64f32d-584b-42bd-9f3d-34412f88d4b1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:51.520021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 839/1693] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:51.543580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df5a18f5181747d8b8f9d5e4af0bb24b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79949cc0b7484d9aa4a94b93d5511fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:51.552828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:51.553261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:51.553564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:51.559749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:51.560156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:51.561874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:51.603348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:51.607070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:51.608400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 855/1694] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:51.653568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983193b-21d0-4125-9131-269bd7996560 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:51.682251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df5a18f5181747d8b8f9d5e4af0bb24b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79949cc0b7484d9aa4a94b93d5511fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:51.682947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:51.683242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:51.686320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:51.689506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:51.699173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:51.801242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:51.808494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 840/1695] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:51 2022] POST /identity/v3/projects => generated 355 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:56:51.812887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37d85a-1d7d-41db-bd7a-6529161bc285 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:51.970543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df5a18f5181747d8b8f9d5e4af0bb24b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79949cc0b7484d9aa4a94b93d5511fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:51.971246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:51.971542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:51.971826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:51.975857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:51.982369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:51.983985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:52.033112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 856/1696] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:52.106285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:52.119166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f0183-e71c-4df7-b0fe-9ba662d44e2f tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:52.126271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df5a18f5181747d8b8f9d5e4af0bb24b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79949cc0b7484d9aa4a94b93d5511fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:52.127833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:52.128267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:52.128687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] PATH_INFO: `/v3/projects/c57120c2c46043188ed7b96ccb73b8a3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:52.130156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c57120c2c46043188ed7b96ccb73b8a3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:52.132750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:52.203054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57120c2c46043188ed7b96ccb73b8a3', 'request_id': 'req-673e7844-75a8-482d-81cd-6a6403cc13ba'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:52.218032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57120c2c46043188ed7b96ccb73b8a3', 'request_id': 'req-673e7844-75a8-482d-81cd-6a6403cc13ba'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:52.235624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57120c2c46043188ed7b96ccb73b8a3', 'request_id': 'req-673e7844-75a8-482d-81cd-6a6403cc13ba'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:52.253206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] The token cache is being invalidate because project c57120c2c46043188ed7b96ccb73b8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:56:52.253843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:52.256404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-673e7844-75a8-482d-81cd-6a6403cc13ba tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:52.266434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 841/1697] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:56:52 2022] DELETE /identity/v3/projects/c57120c2c46043188ed7b96ccb73b8a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:52.716514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:52.718880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:52.979261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503159c5-1f13-4b26-826d-e1bf003e86b7 tempest-VolumeQuotaClassesTest-1699676729 tempest-VolumeQuotaClassesTest-1699676729-project-admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:53.072791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ad89-2775-46a8-845c-95efa5a1fa81 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:53.073412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ad89-2775-46a8-845c-95efa5a1fa81 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:53.073932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ad89-2775-46a8-845c-95efa5a1fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:53.125967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fab8ad89-2775-46a8-845c-95efa5a1fa81 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:53.127719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fab8ad89-2775-46a8-845c-95efa5a1fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:53.135902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:53.139756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:53.140052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:53.140373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] PATH_INFO: `/v3/users/c097b58cf4d94a5bacb2c9db7cad47ab` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:53.142728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c097b58cf4d94a5bacb2c9db7cad47ab)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:53.161788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:53.292602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 842/1698] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:56:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:56:53.296751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:53.320737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c097b58cf4d94a5bacb2c9db7cad47ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:53.320737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c097b58cf4d94a5bacb2c9db7cad47ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:53.321535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c097b58cf4d94a5bacb2c9db7cad47ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:53.335561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c097b58cf4d94a5bacb2c9db7cad47ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:53.337858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c097b58cf4d94a5bacb2c9db7cad47ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:53.397036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 857/1699] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:56:52 2022] DELETE /identity/v3/users/c097b58cf4d94a5bacb2c9db7cad47ab => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:53.401315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:53.401792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:53.401923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:53.451033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:53.452479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:53.472894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:53.554029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:53.562917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:53.672328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 843/1700] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:53.707381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:53.709024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:53.775991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e7a96-cd78-4513-9f6b-8994a825cc29 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:53.788028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000ca66-4efd-4ea2-b400-9402d3d72ac9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:53.789235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000ca66-4efd-4ea2-b400-9402d3d72ac9 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:53.789781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000ca66-4efd-4ea2-b400-9402d3d72ac9 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:53.791242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000ca66-4efd-4ea2-b400-9402d3d72ac9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:53.799803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c000ca66-4efd-4ea2-b400-9402d3d72ac9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:53.942615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ae5b3-8a3c-4b63-9e66-4050bc99461f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:53.962501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201ed6-245d-4d7b-aae5-4136c4a1d1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:53.963203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201ed6-245d-4d7b-aae5-4136c4a1d1aa service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:53.963496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201ed6-245d-4d7b-aae5-4136c4a1d1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:53.963783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201ed6-245d-4d7b-aae5-4136c4a1d1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:53.993382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000ca66-4efd-4ea2-b400-9402d3d72ac9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:53.995532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201ed6-245d-4d7b-aae5-4136c4a1d1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:53.997280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201ed6-245d-4d7b-aae5-4136c4a1d1aa service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:53.999446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000ca66-4efd-4ea2-b400-9402d3d72ac9 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:54.010026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 844/1701] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:54.011422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:54.011727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:54.012006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:54.032083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 858/1702] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 09:56:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:56:54.032594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] MFA Rules not processed for user `c216711b9e9b45f09f4917fe7b8275ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:54.034002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:54.247518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 845/1703] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:54.464566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:54.464921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:54.465179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:54.606453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] MFA Rules not processed for user `e62d9d781281497e9927c0eb0e85dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:54.616060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:54.832881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:54.909712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 859/1704] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:54.952316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:54.954801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:54.990077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:54.991613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:54.998573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6123-04e7-4f7a-94c9-f20ea3a435cc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:55.022036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:55.025214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd1caf-afd9-4df4-9134-5ce39c061664 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:55.034172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:55.037171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:55.038100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] PATH_INFO: `/v3/users/473e9dc191f841949aadc6a13b1290ae` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:55.045119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] RBAC: Authorizing `identity:delete_user(user_id=473e9dc191f841949aadc6a13b1290ae)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:55.054790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:55.065876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:55.074583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:55.074902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:55.075192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] PATH_INFO: `/v3/users/e626c5895fc948519bb83bc984dae125` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:55.093276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] RBAC: Authorizing `identity:delete_user(user_id=e626c5895fc948519bb83bc984dae125)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:55.106051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:55.212203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473e9dc191f841949aadc6a13b1290ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.226396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473e9dc191f841949aadc6a13b1290ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.227664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473e9dc191f841949aadc6a13b1290ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.231072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:55.246780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473e9dc191f841949aadc6a13b1290ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.248190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a964c18b-4855-4565-8351-c60b17f7081c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473e9dc191f841949aadc6a13b1290ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.291068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 846/1705] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:56:54 2022] DELETE /identity/v3/users/473e9dc191f841949aadc6a13b1290ae => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:55.294312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:55.295407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:55.296142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:55.346891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:55.356415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:55.361570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e626c5895fc948519bb83bc984dae125'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.384260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e626c5895fc948519bb83bc984dae125'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.385062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e626c5895fc948519bb83bc984dae125'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.405006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e626c5895fc948519bb83bc984dae125'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.405971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f78978d-17b7-4ac5-bcfe-ac6f158eaece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e626c5895fc948519bb83bc984dae125'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:55.452984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 860/1706] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:56:54 2022] DELETE /identity/v3/users/e626c5895fc948519bb83bc984dae125 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:56:55.461618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:55.461952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:55.462245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:55.520615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:55.522322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:55.707279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 847/1707] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:55.784431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:55.786138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:55.827512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 861/1708] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:55.832504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:55.835494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:55.992794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:55.995940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1933955-a4b6-49d5-80ab-4dcad69fe006 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:56.014216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf342f5-bb5e-4b52-b2c2-936219b643cc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:56.060264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:56.061363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:56.061363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:56.064426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:56.066894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:56.166890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:56.169958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:56.171357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:56.171777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:56.217504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:56.220726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:56.241135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 848/1709] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:56:56.242075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:56.258051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:56.259765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:56.260701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203693be-f284-4405-93a0-4c53299245e2 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:56.270368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:56.271049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:56.271340 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:56.271627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:56.273781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 862/1710] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:56.298307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:56.298307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:56.317741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 849/1711] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:57.159985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:57.163235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:57.190679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e787522-b1b5-4988-a924-d5aae2be0201 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:57.209734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:57.216217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:57.217427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:57.219422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] PATH_INFO: `/v3/projects/c544913f779c448ca7f3931f571cb3cd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:57.222438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c544913f779c448ca7f3931f571cb3cd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:57.225109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:57.292649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:57.294104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:57.315836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e51d-680a-4828-9261-498e90a0d779 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:57.327534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:57.328415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:57.328699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:57.328975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] PATH_INFO: `/v3/projects/433ca0cf7c0b4e159c1cc2bde0ceacf4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:57.335029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=433ca0cf7c0b4e159c1cc2bde0ceacf4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:57.336948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:57.348125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c544913f779c448ca7f3931f571cb3cd', 'request_id': 'req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.372534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c544913f779c448ca7f3931f571cb3cd', 'request_id': 'req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.374769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:57.400310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c544913f779c448ca7f3931f571cb3cd', 'request_id': 'req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.451200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] The token cache is being invalidate because project c544913f779c448ca7f3931f571cb3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:56:57.453060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.455841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.463904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 863/1712] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:56:57 2022] DELETE /identity/v3/projects/c544913f779c448ca7f3931f571cb3cd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:57.464043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433ca0cf7c0b4e159c1cc2bde0ceacf4', 'request_id': 'req-3ff10069-4d1f-4082-b08a-a410e79fbe54'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.468127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:57.471228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:57.483765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433ca0cf7c0b4e159c1cc2bde0ceacf4', 'request_id': 'req-3ff10069-4d1f-4082-b08a-a410e79fbe54'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.502066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433ca0cf7c0b4e159c1cc2bde0ceacf4', 'request_id': 'req-3ff10069-4d1f-4082-b08a-a410e79fbe54'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.557324 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] The token cache is being invalidate because project 433ca0cf7c0b4e159c1cc2bde0ceacf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:56:57.558184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.559278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.564505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 850/1713] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:56:57 2022] DELETE /identity/v3/projects/433ca0cf7c0b4e159c1cc2bde0ceacf4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:56:57.568862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:57.574249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:57.678193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa43a4-2af8-484f-bda4-5a6ae24637e7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:57.777630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:57.816108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10069-4d1f-4082-b08a-a410e79fbe54 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:57.838461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:57.839587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:57.840040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:57.840482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] PATH_INFO: `/v3/users/df5a18f5181747d8b8f9d5e4af0bb24b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:57.842391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5a18f5181747d8b8f9d5e4af0bb24b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:57.856356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:57.894203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:57.896745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:57.897040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:57.897382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] PATH_INFO: `/v3/projects/0113e961aabb493a979359ef3a0125fc` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:57.908284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0113e961aabb493a979359ef3a0125fc)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:57.911454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:57.977124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5a18f5181747d8b8f9d5e4af0bb24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.987330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5a18f5181747d8b8f9d5e4af0bb24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:57.988246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5a18f5181747d8b8f9d5e4af0bb24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.000713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5a18f5181747d8b8f9d5e4af0bb24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.002316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5a18f5181747d8b8f9d5e4af0bb24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.048293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 851/1714] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:56:57 2022] DELETE /identity/v3/users/df5a18f5181747d8b8f9d5e4af0bb24b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:58.048293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:58.048532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:58.096148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:58.133742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0113e961aabb493a979359ef3a0125fc', 'request_id': 'req-510d67dc-a1ec-40a2-918a-fa705747f9b4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.155863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e642e2b-e923-4e4e-9402-2ab4513c6c4e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:58.159940 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0113e961aabb493a979359ef3a0125fc', 'request_id': 'req-510d67dc-a1ec-40a2-918a-fa705747f9b4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.199132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0113e961aabb493a979359ef3a0125fc', 'request_id': 'req-510d67dc-a1ec-40a2-918a-fa705747f9b4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.262376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] The token cache is being invalidate because project 0113e961aabb493a979359ef3a0125fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:56:58.264209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.266154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-510d67dc-a1ec-40a2-918a-fa705747f9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.275783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:58.279266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:58.279566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:58.283717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] PATH_INFO: `/v3/users/d2e7870bd46e4294bbc1b26916bf4ea6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:58.283892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e7870bd46e4294bbc1b26916bf4ea6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:58.284172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 864/1715] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:56:57 2022] DELETE /identity/v3/projects/0113e961aabb493a979359ef3a0125fc => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:58.285851 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09096872-3f0a-4ac2-93d4-6e3ccd6dab5a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:58.291016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09096872-3f0a-4ac2-93d4-6e3ccd6dab5a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:58.291526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09096872-3f0a-4ac2-93d4-6e3ccd6dab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:58.295015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:58.367625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-09096872-3f0a-4ac2-93d4-6e3ccd6dab5a None None] MFA Rules not processed for user `2585af8b95ea48d1a3576bd722536fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:58.369017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-09096872-3f0a-4ac2-93d4-6e3ccd6dab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:58.467601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 865/1716] 10.222.0.67 () {58 vars in 1015 bytes} [Fri Jun 3 09:56:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:58.475108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b40ef0-92ab-455a-a5e4-55204b896e82 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:58.477321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b40ef0-92ab-455a-a5e4-55204b896e82 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:58.478049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b40ef0-92ab-455a-a5e4-55204b896e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:58.537356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e7870bd46e4294bbc1b26916bf4ea6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.564840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b5b40ef0-92ab-455a-a5e4-55204b896e82 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:58.570241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b5b40ef0-92ab-455a-a5e4-55204b896e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:58.571842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e7870bd46e4294bbc1b26916bf4ea6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.574296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e7870bd46e4294bbc1b26916bf4ea6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.602223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e7870bd46e4294bbc1b26916bf4ea6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.603968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e7870bd46e4294bbc1b26916bf4ea6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:56:58.615978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 866/1717] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:58.622459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15dcf-2132-4982-bee7-54e69e4d821e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:58.623222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15dcf-2132-4982-bee7-54e69e4d821e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:58.623527 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15dcf-2132-4982-bee7-54e69e4d821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:58.679041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 852/1718] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:56:58 2022] DELETE /identity/v3/users/d2e7870bd46e4294bbc1b26916bf4ea6 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:56:58.705433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ebb15dcf-2132-4982-bee7-54e69e4d821e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:58.712516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ebb15dcf-2132-4982-bee7-54e69e4d821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:58.752524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:58.754072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:58.922994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 867/1719] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:56:58.923983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15dcf-2132-4982-bee7-54e69e4d821e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:58.932260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:58.943051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f098-9d30-4c66-81a6-deef0ed79845 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:58.946781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:58.953509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15dcf-2132-4982-bee7-54e69e4d821e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:58.958577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:58.959494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:58.959494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:58.959805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:58.965489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:58.967651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:58.967953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:58.969857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:58.971480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:56:58.971568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:56:58.971649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:58.975511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:58.993378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:58.994885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:59.020963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 853/1721] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:56:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:56:59.021899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:59.025398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 868/1721] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:56:59.049377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999ada1-0fbf-46af-8b38-c43f5ffa5d42 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:59.058954 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:59.059681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:59.059986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:59.060289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:59.061055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:59.063018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:59.117925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 854/1722] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:56:59 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:59.118234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:59.139746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d22ac-c004-4e0f-be3c-614fbae7d39e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:59.336982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:59.338457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:59.338829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:59.339110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:59.339833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:59.343410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:59.459186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:59.471108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 869/1723] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:56:59 2022] POST /identity/v3/users => generated 286 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:56:59.475593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded3aa-4f28-4ca9-a06d-d91551233668 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:59.515015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:59.516938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:59.519711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:59.520582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:59.526318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:59.535589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:59.586583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 855/1724] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:59.590630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:59.619588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb24e-93dd-492c-ae50-0c4d12f1e7f7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:59.633833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac1fa3-3442-4094-b66c-2d93ef1c50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:59.634537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1fa3-3442-4094-b66c-2d93ef1c50f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:59.634825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1fa3-3442-4094-b66c-2d93ef1c50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:59.635143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1fa3-3442-4094-b66c-2d93ef1c50f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:59.635907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac1fa3-3442-4094-b66c-2d93ef1c50f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:59.638556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac1fa3-3442-4094-b66c-2d93ef1c50f2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:59.670090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:56:59.681671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe32a-5dd7-4875-bf23-11933212bde7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:56:59.683565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 870/1725] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:56:59.708133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:56:59.709352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:59.709810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:59.710254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] PATH_INFO: `/v3/projects/044479346f4640fd92a1d4c48689e856/users/bbaf7c6533554d65944a1b53e0a27307/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:59.744076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044479346f4640fd92a1d4c48689e856, user_id=bbaf7c6533554d65944a1b53e0a27307, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:56:59.772908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:56:59.839161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e3bd-4c6c-496d-a6f2-48a6d4e1a9e3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:56:59.840065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e3bd-4c6c-496d-a6f2-48a6d4e1a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:56:59.841182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e3bd-4c6c-496d-a6f2-48a6d4e1a9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:56:59.857410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 856/1726] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:56:59 2022] PUT /identity/v3/projects/044479346f4640fd92a1d4c48689e856/users/bbaf7c6533554d65944a1b53e0a27307/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:56:59.967036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-92a1e3bd-4c6c-496d-a6f2-48a6d4e1a9e3 None None] MFA Rules not processed for user `bbaf7c6533554d65944a1b53e0a27307`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:56:59.975016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-92a1e3bd-4c6c-496d-a6f2-48a6d4e1a9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:00.189723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 871/1727] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:56:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:00.192401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:00.353260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf0fb0-5898-4773-9477-3c6b5cac9da0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:00.369857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:00.370551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:00.370836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:00.371120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:00.371816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:00.375532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:00.452347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 857/1728] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:00 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:00.454442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1e3bd-4c6c-496d-a6f2-48a6d4e1a9e3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:00.491837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1e3bd-4c6c-496d-a6f2-48a6d4e1a9e3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:00.731599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:00.732330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:00.732628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:00.732919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:00.734343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:00.740634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:00.763418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:00.800840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 872/1729] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:00 2022] POST /identity/v3/users => generated 292 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:00.802660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:00.816824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1a33-fe70-41a9-ab6e-561149efb36c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:00.824582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:00.825323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:00.825692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:00.826146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:00.826903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:00.828734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:00.892266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 858/1730] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:00.893505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:00.927529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71af8f-7ea9-42d0-a44e-d52a30028f94 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:00.932786 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:00.934370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:00.934970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:00.935824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] PATH_INFO: `/v3/projects/ea8b096f7dbd4a1d875e546d60a7dd8f/users/ad612c952d2c4dd8b4b7c56391b90160/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:00.963731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8b096f7dbd4a1d875e546d60a7dd8f, user_id=ad612c952d2c4dd8b4b7c56391b90160, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:00.970241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:01.033993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 873/1731] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:00 2022] PUT /identity/v3/projects/ea8b096f7dbd4a1d875e546d60a7dd8f/users/ad612c952d2c4dd8b4b7c56391b90160/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:01.034679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:01.045488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3ff80-fa2b-4394-bec9-62c3c4c060f3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:01.229008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af088a26-b0fd-4527-98cc-7d55573dd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:01.232548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088a26-b0fd-4527-98cc-7d55573dd411 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:01.233920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088a26-b0fd-4527-98cc-7d55573dd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:01.237173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088a26-b0fd-4527-98cc-7d55573dd411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:01.238617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af088a26-b0fd-4527-98cc-7d55573dd411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:01.243610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af088a26-b0fd-4527-98cc-7d55573dd411 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:01.269742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:01.271201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 859/1732] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:01.284710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c1f16-11ec-4722-bab0-1aab67f53b9d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:01.312743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:01.318839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:01.321850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:01.322407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] PATH_INFO: `/v3/projects/ea8b096f7dbd4a1d875e546d60a7dd8f/users/ad612c952d2c4dd8b4b7c56391b90160/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:01.325346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8b096f7dbd4a1d875e546d60a7dd8f, user_id=ad612c952d2c4dd8b4b7c56391b90160, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:01.328677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:01.380395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:01.380701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:01.381032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:01.382883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 874/1733] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:01 2022] PUT /identity/v3/projects/ea8b096f7dbd4a1d875e546d60a7dd8f/users/ad612c952d2c4dd8b4b7c56391b90160/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:01.390654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:01.448420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] MFA Rules not processed for user `ad612c952d2c4dd8b4b7c56391b90160`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:01.455571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:01.647953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 860/1734] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:01.659572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:01.662510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:01.791675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54b3d8-fc43-4b16-a155-646bdf346d79 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:01.796067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:01.796931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:01.797336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:01.797776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:01.810631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:01.812414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:01.827795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 875/1735] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:02.669670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:02.673610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:02.779121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:02.921131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696c2f6-6185-4dd1-84c8-4e43eea1fa41 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:02.981970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:02.983457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:02.983853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:02.984241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] PATH_INFO: `/v3/projects/79949cc0b7484d9aa4a94b93d5511fbd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:02.990586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79949cc0b7484d9aa4a94b93d5511fbd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:02.993168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:03.013456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c3aa-9ec4-41d4-ae76-1a5f1631454d service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:03.033172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:03.036177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:03.036489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:03.040945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] PATH_INFO: `/v3/users/bbaf7c6533554d65944a1b53e0a27307` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:03.046478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbaf7c6533554d65944a1b53e0a27307)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:03.050751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:03.168228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79949cc0b7484d9aa4a94b93d5511fbd', 'request_id': 'req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.177847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbaf7c6533554d65944a1b53e0a27307'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.186499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbaf7c6533554d65944a1b53e0a27307'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.187361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbaf7c6533554d65944a1b53e0a27307'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.191403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:03.196686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79949cc0b7484d9aa4a94b93d5511fbd', 'request_id': 'req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.204773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbaf7c6533554d65944a1b53e0a27307'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.225312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7eb6ebb0-27ed-495d-865f-bc76e63cb99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbaf7c6533554d65944a1b53e0a27307'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.243796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79949cc0b7484d9aa4a94b93d5511fbd', 'request_id': 'req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.287423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 876/1736] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:02 2022] DELETE /identity/v3/users/bbaf7c6533554d65944a1b53e0a27307 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:03.292629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e219-56a5-48f0-8e46-d18b2fdfa4a5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:03.293857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e219-56a5-48f0-8e46-d18b2fdfa4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:03.294968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e219-56a5-48f0-8e46-d18b2fdfa4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:03.315486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] The token cache is being invalidate because project 79949cc0b7484d9aa4a94b93d5511fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:03.315486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.326133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a7dae51d-172d-43fa-8d03-7edf4ab6a78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:03.329034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 861/1737] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:02 2022] DELETE /identity/v3/projects/79949cc0b7484d9aa4a94b93d5511fbd => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:03.333707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:03.334033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:03.334325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:03.351834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ab76e219-56a5-48f0-8e46-d18b2fdfa4a5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:03.353386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ab76e219-56a5-48f0-8e46-d18b2fdfa4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:03.380313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:03.381859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:03.419266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:03.555893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 877/1738] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:03.556102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 862/1739] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:03.588957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e021d82-718a-47c7-81f8-874afdff70ac None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:03.589257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e021d82-718a-47c7-81f8-874afdff70ac None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:03.589548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e021d82-718a-47c7-81f8-874afdff70ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:03.633305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:03.635515 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:03.670717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8e021d82-718a-47c7-81f8-874afdff70ac None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:03.675903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8e021d82-718a-47c7-81f8-874afdff70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:03.717445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 878/1740] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:03.719235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e021d82-718a-47c7-81f8-874afdff70ac None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:03.750509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e021d82-718a-47c7-81f8-874afdff70ac None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:03.770548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:03.772264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:03.773834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:03.777559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:03.779175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:03.779743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:03.782514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:03.810568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720da97-8a1e-4072-b2f6-7aef19ad13bb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:03.816267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:03.817242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:03.817983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:03.818656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:03.821338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 879/1741] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:57:03.822972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:03.834376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:03.836367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:03.850663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54951a62-15ff-479c-a7d6-311043c669a2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:03.868206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:03.868432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 863/1742] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:03.869402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:03.869788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:03.871440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:03.872322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:03.878582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:03.990909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 880/1743] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:03 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:03.993182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:04.035361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8fde2-e6f5-40d4-afd0-3338d00fba47 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:04.296195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170355-9c8c-4a94-b413-19f0c7007195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:04.298598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170355-9c8c-4a94-b413-19f0c7007195 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.300245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170355-9c8c-4a94-b413-19f0c7007195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.300718 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170355-9c8c-4a94-b413-19f0c7007195 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.304465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170355-9c8c-4a94-b413-19f0c7007195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:04.309198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170355-9c8c-4a94-b413-19f0c7007195 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:04.388911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 864/1744] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:03 2022] POST /identity/v3/users => generated 291 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:04.393848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:04.407590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56381b63-911d-4168-a4f6-78a872fd78a8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:04.420516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4290ff-c53c-461a-a6dd-059e43ac0ce8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.420829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4290ff-c53c-461a-a6dd-059e43ac0ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.421109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4290ff-c53c-461a-a6dd-059e43ac0ce8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.425196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 865/1745] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 09:57:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:57:04.430427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ce4cd-3af3-4794-914d-f60452cdde54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:04.431401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ce4cd-3af3-4794-914d-f60452cdde54 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.431722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ce4cd-3af3-4794-914d-f60452cdde54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.432078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ce4cd-3af3-4794-914d-f60452cdde54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.433562 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ce4cd-3af3-4794-914d-f60452cdde54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:04.436002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ce4cd-3af3-4794-914d-f60452cdde54 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:04.454436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 881/1746] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:04.455762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4290ff-c53c-461a-a6dd-059e43ac0ce8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:04.476667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4290ff-c53c-461a-a6dd-059e43ac0ce8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:04.498194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:04.498922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.499211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.499501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.500251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:04.501969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:04.535664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b1fc8-535e-487e-ab5c-c551eb99fcf0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.536318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b1fc8-535e-487e-ab5c-c551eb99fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.536806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b1fc8-535e-487e-ab5c-c551eb99fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.562228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 866/1747] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:04.571218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:04.603136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e57b1fc8-535e-487e-ab5c-c551eb99fcf0 None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:04.607855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255446-9bb1-4b57-8b95-021f7a32fa45 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:04.608929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e57b1fc8-535e-487e-ab5c-c551eb99fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:04.629147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:04.630227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.632295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.632295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] PATH_INFO: `/v3/projects/ef62bf45043945e38f71be5b14b79c29/users/596026c550bf4a0f89c45c26e969eef7/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.679653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef62bf45043945e38f71be5b14b79c29, user_id=596026c550bf4a0f89c45c26e969eef7, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:04.684655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:04.746090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 867/1748] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:04 2022] PUT /identity/v3/projects/ef62bf45043945e38f71be5b14b79c29/users/596026c550bf4a0f89c45c26e969eef7/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:04.747178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:04.763009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:04.830148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:04.961338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408c64-9b53-4727-8e3c-8de70c67e16a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:04.976159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 882/1749] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 09:57:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:04.982643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:04.983702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.984054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:04.984165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.984363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:04.984661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.984947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] PATH_INFO: `/v3/projects/cfccd879bc1d415582d64a8d54dd9990` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:04.990839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfccd879bc1d415582d64a8d54dd9990)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:04.992999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:05.069196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:05.088533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] MFA Rules not processed for user `596026c550bf4a0f89c45c26e969eef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:05.089923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:05.160516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfccd879bc1d415582d64a8d54dd9990', 'request_id': 'req-4b9c3171-267f-485f-85dd-6ada1bef2dc0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:05.198483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfccd879bc1d415582d64a8d54dd9990', 'request_id': 'req-4b9c3171-267f-485f-85dd-6ada1bef2dc0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:05.210987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfccd879bc1d415582d64a8d54dd9990', 'request_id': 'req-4b9c3171-267f-485f-85dd-6ada1bef2dc0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:05.242071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] The token cache is being invalidate because project cfccd879bc1d415582d64a8d54dd9990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:05.242459 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:05.244723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b9c3171-267f-485f-85dd-6ada1bef2dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:05.252111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 868/1750] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:04 2022] DELETE /identity/v3/projects/cfccd879bc1d415582d64a8d54dd9990 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:05.262593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548154d-6d22-47cd-9ff8-088c7f648add None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:05.263219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548154d-6d22-47cd-9ff8-088c7f648add None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:05.263740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548154d-6d22-47cd-9ff8-088c7f648add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:05.331164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 883/1751] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:05.332614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e548154d-6d22-47cd-9ff8-088c7f648add None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:05.334597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e548154d-6d22-47cd-9ff8-088c7f648add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:05.336901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:05.346746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:05.396378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583f19-b462-4f7c-95e8-59651e180df0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:05.487025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 869/1752] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:05.494720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0a6ce-66b6-45e9-9ce6-4d2189d3bb1d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:05.495351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0a6ce-66b6-45e9-9ce6-4d2189d3bb1d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:05.495878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0a6ce-66b6-45e9-9ce6-4d2189d3bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:05.552698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0bc0a6ce-66b6-45e9-9ce6-4d2189d3bb1d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:05.558552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0bc0a6ce-66b6-45e9-9ce6-4d2189d3bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:05.573373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:05.575396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:05.576151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:05.576666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:05.581205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:05.585135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:05.585575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 870/1753] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:05.588990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0a6ce-66b6-45e9-9ce6-4d2189d3bb1d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:05.609667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0a6ce-66b6-45e9-9ce6-4d2189d3bb1d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:05.623986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:05.625448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:05.626470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:05.627051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:05.631402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:05.631947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:05.633840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:05.647231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 884/1754] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:05 2022] POST /identity/v3/projects => generated 381 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:05.662057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:05.666117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 871/1755] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:57:05.670355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:05.690813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4307e-37f6-46f4-9dc4-2b56fa6603d3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:05.758216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:05.799657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f972d-205f-4783-b64b-3801f3439043 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:05.810618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:05.811889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:05.812899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:05.814448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:05.819465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:05.821090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:05.829360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:05.830718 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:05.832300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:05.833521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:05.835170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:05.837736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:05.856556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 885/1756] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:05 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:05.886884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:05.902712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 872/1757] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:05 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:05.904065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:05.929165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995d5dd-0a25-474f-8182-ebc1728af521 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.020721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:06.107288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab2e02-32af-4284-bad7-9c57fb6663ad admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.123231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.124101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.124504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.124898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.125796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.132044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.194391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.197488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.199122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.199436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.204146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.210567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.210888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 873/1758] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:05 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:06.212321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:06.231019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:06.271585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 886/1759] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:06.275248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:06.318659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b944526-d3d0-4dde-a080-24c655e13dd5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.335467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.336163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.338084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.339342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.342077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.348999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.395379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 887/1760] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:06.404092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:06.439678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1b2d9-0a84-4daa-9ad7-15268c5a23f8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.456549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.457794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.458546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.459454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] PATH_INFO: `/v3/projects/af56505f91cb4fc6bf70a865487e04f9/users/53d83088e1b545b29cc4d0d0868e37c3/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.506390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af56505f91cb4fc6bf70a865487e04f9, user_id=53d83088e1b545b29cc4d0d0868e37c3, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.518945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.520860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50244e97-eef2-4eb6-a575-296a44d05e0e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.548005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.548905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.549481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.549690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.554407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 888/1761] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:06 2022] PUT /identity/v3/projects/af56505f91cb4fc6bf70a865487e04f9/users/53d83088e1b545b29cc4d0d0868e37c3/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:06.557295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:06.559069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:06.608377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.611727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.638237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 874/1762] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:06.639700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:06.663666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c3140-5046-41ee-b209-bcddd9ccb0c5 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.715318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:06.771386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.772022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.773798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.773798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.774752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.776780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.792648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 875/1763] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:06.796994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:06.845134 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acefe8-dc40-4231-b9e6-a20a74c92b06 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.858989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90cce-842e-4d37-b02a-09854626a2cd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:06.875749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.877073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.877397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.877727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.878597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.894963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60b19d-6a8d-478f-85ba-22cc282dea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:06.900324 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60b19d-6a8d-478f-85ba-22cc282dea72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:06.903932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60b19d-6a8d-478f-85ba-22cc282dea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:06.904594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60b19d-6a8d-478f-85ba-22cc282dea72 admin admin] PATH_INFO: `/v3/projects/af56505f91cb4fc6bf70a865487e04f9/users/53d83088e1b545b29cc4d0d0868e37c3/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:06.908365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.919168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60b19d-6a8d-478f-85ba-22cc282dea72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af56505f91cb4fc6bf70a865487e04f9, user_id=53d83088e1b545b29cc4d0d0868e37c3, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:06.937239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60b19d-6a8d-478f-85ba-22cc282dea72 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:06.963823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 889/1764] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:06.969866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:06.994650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 876/1765] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:06 2022] PUT /identity/v3/projects/af56505f91cb4fc6bf70a865487e04f9/users/53d83088e1b545b29cc4d0d0868e37c3/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:07.010325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:07.010877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:07.011468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:07.046869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cc447-553a-4013-98c0-c87651342aba admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:07.095283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] MFA Rules not processed for user `53d83088e1b545b29cc4d0d0868e37c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:07.104950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:07.248521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbdee-67c0-4532-b971-760e917fbf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:07.249464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbdee-67c0-4532-b971-760e917fbf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:07.249766 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbdee-67c0-4532-b971-760e917fbf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:07.252195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbdee-67c0-4532-b971-760e917fbf3c admin admin] PATH_INFO: `/v3/projects/f7676e81a902486094ce23edbc695eec/users/09c82a592bf948019df33a5f3deeee3f/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:07.269627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 877/1766] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:07.278376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:07.279963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:07.294804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbdee-67c0-4532-b971-760e917fbf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7676e81a902486094ce23edbc695eec, user_id=09c82a592bf948019df33a5f3deeee3f, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:07.300709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbdee-67c0-4532-b971-760e917fbf3c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:07.320364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:07.330704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 890/1767] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:06 2022] PUT /identity/v3/projects/f7676e81a902486094ce23edbc695eec/users/09c82a592bf948019df33a5f3deeee3f/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:07.342793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bd6b7-6372-4544-9c34-3ba66fd7205f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:07.343277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bd6b7-6372-4544-9c34-3ba66fd7205f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:07.343743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bd6b7-6372-4544-9c34-3ba66fd7205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:07.444980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e20bd6b7-6372-4544-9c34-3ba66fd7205f None None] MFA Rules not processed for user `09c82a592bf948019df33a5f3deeee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:07.451310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e20bd6b7-6372-4544-9c34-3ba66fd7205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:07.461550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c0ef-6cf9-4b33-85f5-f201b9da7c60 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:07.582912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:07.583595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:07.584237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:07.584597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:07.598944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:07.614735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 891/1768] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:07.616966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bd6b7-6372-4544-9c34-3ba66fd7205f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:07.758509 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:07.767994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:07.808305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bd6b7-6372-4544-9c34-3ba66fd7205f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:07.809385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 878/1769] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:07.825317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:07.830682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:07.830981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:07.831320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:07.832184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:07.840196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:07.943180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 892/1770] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:07 2022] POST /identity/v3/projects => generated 383 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:07.947209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:07.977916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9876b2-278f-48e8-bb0d-401f20f38d70 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:08.131917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:08.133865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.134371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.134800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.146064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:08.151001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:08.229460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 879/1771] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:07 2022] POST /identity/v3/users => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:08.231035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:08.259015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:08.262982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494322-0438-4fd6-af86-33a01e592a8f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:08.266904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:08.286044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:08.286754 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.286925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.287199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.288070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:08.295765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:08.309791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840071f-c90a-453d-83d0-5e9156302d3c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:08.343448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:08.345223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.346201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.346790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] PATH_INFO: `/v3/projects/044479346f4640fd92a1d4c48689e856` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.348312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 893/1772] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:08.349660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:08.354261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044479346f4640fd92a1d4c48689e856)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:08.356692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:08.368539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57483-ce69-4463-9ead-a26ced878f66 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:08.376067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:08.376984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.377430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.377794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] PATH_INFO: `/v3/projects/e99e872b7ff640cdb8888089b099e578/users/49b8a02c1a0f4c86bdba88373a7e0e43/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.417396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99e872b7ff640cdb8888089b099e578, user_id=49b8a02c1a0f4c86bdba88373a7e0e43, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:08.420704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:08.440635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 894/1773] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:08 2022] PUT /identity/v3/projects/e99e872b7ff640cdb8888089b099e578/users/49b8a02c1a0f4c86bdba88373a7e0e43/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:08.444296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:08.493636 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044479346f4640fd92a1d4c48689e856', 'request_id': 'req-655517e1-3aa3-4698-8144-b9e3b34dc4b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.510533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044479346f4640fd92a1d4c48689e856', 'request_id': 'req-655517e1-3aa3-4698-8144-b9e3b34dc4b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.522790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044479346f4640fd92a1d4c48689e856', 'request_id': 'req-655517e1-3aa3-4698-8144-b9e3b34dc4b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.537277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:08.554362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] The token cache is being invalidate because project 044479346f4640fd92a1d4c48689e856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:08.555020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.555936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-655517e1-3aa3-4698-8144-b9e3b34dc4b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.559971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 880/1774] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:08 2022] DELETE /identity/v3/projects/044479346f4640fd92a1d4c48689e856 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:08.562497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.562497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.562879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.576812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117894-26ff-4b12-9132-b16f3cc2b874 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:08.592754 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] MFA Rules not processed for user `e62d9d781281497e9927c0eb0e85dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:08.594170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:08.614569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:08.702013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 881/1775] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:08.703187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:08.705511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:08.707530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:08.708284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.708637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.709000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.712075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:08.715625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:08.720704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6960b-bee6-4e51-bd6e-1aed8db3c666 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:08.726025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:08.727004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.727366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.727722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] PATH_INFO: `/v3/users/ad612c952d2c4dd8b4b7c56391b90160` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.728909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 895/1776] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:08.729932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:08.732064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:08.732840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad612c952d2c4dd8b4b7c56391b90160)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:08.735094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:08.771828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756c59-03db-4f74-b11b-b11a4e40347f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:08.779071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:08.780568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.781122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.781575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] PATH_INFO: `/v3/users/596026c550bf4a0f89c45c26e969eef7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.783083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] RBAC: Authorizing `identity:delete_user(user_id=596026c550bf4a0f89c45c26e969eef7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:08.786264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:08.820217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad612c952d2c4dd8b4b7c56391b90160'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.832568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad612c952d2c4dd8b4b7c56391b90160'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.833616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad612c952d2c4dd8b4b7c56391b90160'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.844745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad612c952d2c4dd8b4b7c56391b90160'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.846205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad612c952d2c4dd8b4b7c56391b90160'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.858943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596026c550bf4a0f89c45c26e969eef7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.874609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596026c550bf4a0f89c45c26e969eef7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.878501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 882/1777] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:08 2022] DELETE /identity/v3/users/ad612c952d2c4dd8b4b7c56391b90160 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:08.878501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:08.878706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596026c550bf4a0f89c45c26e969eef7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.882309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:08.887470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596026c550bf4a0f89c45c26e969eef7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.888324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-daf1b19a-385c-42a3-91d0-9334a7b8327c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596026c550bf4a0f89c45c26e969eef7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:08.911640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 896/1778] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:08 2022] DELETE /identity/v3/users/596026c550bf4a0f89c45c26e969eef7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:08.919456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:08.920001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:08.920410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:08.958475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:08.960979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:09.061150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:09.076066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5fdb5-c20f-4684-bd52-7c5636f4a7d4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:09.086026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 897/1779] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:09.091608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fd837-5e5c-4752-851d-130ba0d6911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:09.095451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd837-5e5c-4752-851d-130ba0d6911d admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:09.095885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd837-5e5c-4752-851d-130ba0d6911d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:09.096291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd837-5e5c-4752-851d-130ba0d6911d admin admin] PATH_INFO: `/v3/projects/e99e872b7ff640cdb8888089b099e578/users/49b8a02c1a0f4c86bdba88373a7e0e43/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:09.108114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fd837-5e5c-4752-851d-130ba0d6911d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99e872b7ff640cdb8888089b099e578, user_id=49b8a02c1a0f4c86bdba88373a7e0e43, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:09.116197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fd837-5e5c-4752-851d-130ba0d6911d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:09.140698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:09.151138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:09.151319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 883/1780] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:08 2022] PUT /identity/v3/projects/e99e872b7ff640cdb8888089b099e578/users/49b8a02c1a0f4c86bdba88373a7e0e43/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:09.153547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:09.153868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:09.154174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:09.228776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] MFA Rules not processed for user `49b8a02c1a0f4c86bdba88373a7e0e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:09.230238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:09.251390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd2c9b-9a46-42b2-801e-1a8bca2f4744 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:09.258721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:09.308544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:09.310288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:09.310590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:09.310898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:09.395404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 884/1781] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:09.408470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:09.410889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:09.428530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:09.431431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:09.448079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 898/1782] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:09.536914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029243d2-bd77-471d-be3a-63bc91144be3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:09.545921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:09.547304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:09.548355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:09.549681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:09.569568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:09.572535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:09.587273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 885/1783] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:09.729260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:09.744602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:09.746534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:09.758628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791b4ef-8368-4e3b-b7b9-2c633cdd737d service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:09.770357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:09.771824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:09.773342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e10df-408c-44b2-ae0e-a427d1282f30 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:09.773677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:09.774427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:09.778509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:09.787247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:09.791021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:09.792215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:09.792697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] PATH_INFO: `/v3/projects/ea8b096f7dbd4a1d875e546d60a7dd8f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:09.797196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8b096f7dbd4a1d875e546d60a7dd8f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:09.800781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:09.880745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8b096f7dbd4a1d875e546d60a7dd8f', 'request_id': 'req-f6c79817-99e4-4ef9-9064-add131472d30'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:09.897992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8b096f7dbd4a1d875e546d60a7dd8f', 'request_id': 'req-f6c79817-99e4-4ef9-9064-add131472d30'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:09.916364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8b096f7dbd4a1d875e546d60a7dd8f', 'request_id': 'req-f6c79817-99e4-4ef9-9064-add131472d30'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:09.935511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:09.936206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] The token cache is being invalidate because project ea8b096f7dbd4a1d875e546d60a7dd8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:09.936570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:09.937318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6c79817-99e4-4ef9-9064-add131472d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:09.938863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:09.942921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 886/1784] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:09 2022] DELETE /identity/v3/projects/ea8b096f7dbd4a1d875e546d60a7dd8f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:09.944384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:09.945398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b260-954c-4848-8f10-474d8aa52012 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:09.946004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b260-954c-4848-8f10-474d8aa52012 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:09.948988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b260-954c-4848-8f10-474d8aa52012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:09.956484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 899/1785] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:09.995366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-25c1b260-954c-4848-8f10-474d8aa52012 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:10.006174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-25c1b260-954c-4848-8f10-474d8aa52012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:10.015296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.016710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:10.051319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145669-1a9c-4b28-bd5c-2abe6b5f52cd service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:10.083688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:10.159258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 887/1786] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:10.161589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2109-5191-472b-931c-fe2d12b6dcef None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.161919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2109-5191-472b-931c-fe2d12b6dcef None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.162206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2109-5191-472b-931c-fe2d12b6dcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.192341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:10.194159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.194528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.195019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] PATH_INFO: `/v3/projects/ef62bf45043945e38f71be5b14b79c29` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.196965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef62bf45043945e38f71be5b14b79c29)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:10.199367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:10.200882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9fcd2109-5191-472b-931c-fe2d12b6dcef None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:10.202679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9fcd2109-5191-472b-931c-fe2d12b6dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:10.230843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 888/1787] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:10.232660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2109-5191-472b-931c-fe2d12b6dcef None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.245580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2109-5191-472b-931c-fe2d12b6dcef None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:10.253255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:10.254119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.254653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.254961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.256424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:10.256847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:10.259407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:10.279695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 889/1788] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:57:10.281444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.292365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28703251-3391-4a7f-b8b1-b90f4d402522 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:10.311336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef62bf45043945e38f71be5b14b79c29', 'request_id': 'req-d7526841-fc02-4da4-8ad5-50029fe3cdf0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.321143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef62bf45043945e38f71be5b14b79c29', 'request_id': 'req-d7526841-fc02-4da4-8ad5-50029fe3cdf0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.333192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef62bf45043945e38f71be5b14b79c29', 'request_id': 'req-d7526841-fc02-4da4-8ad5-50029fe3cdf0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.362253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] The token cache is being invalidate because project ef62bf45043945e38f71be5b14b79c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:10.363906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.364960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.369728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 900/1789] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:10 2022] DELETE /identity/v3/projects/ef62bf45043945e38f71be5b14b79c29 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:10.373580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.379922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:10.404503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c160c75-e87b-49f7-a5dc-354a64fb892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:10.407140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160c75-e87b-49f7-a5dc-354a64fb892f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.407447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160c75-e87b-49f7-a5dc-354a64fb892f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.407735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160c75-e87b-49f7-a5dc-354a64fb892f admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.408443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c160c75-e87b-49f7-a5dc-354a64fb892f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:10.412661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c160c75-e87b-49f7-a5dc-354a64fb892f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:10.484607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 890/1790] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:10 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:10.486740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aef63d-829a-4103-83be-151d04ef7769 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.487035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aef63d-829a-4103-83be-151d04ef7769 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.487317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aef63d-829a-4103-83be-151d04ef7769 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.493252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 891/1791] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 09:57:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:57:10.494126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aef63d-829a-4103-83be-151d04ef7769 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.498845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-44aef63d-829a-4103-83be-151d04ef7769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:10.520827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526841-fc02-4da4-8ad5-50029fe3cdf0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:10.598606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:10.644095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:10.646084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.646446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.646993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] PATH_INFO: `/v3/users/53d83088e1b545b29cc4d0d0868e37c3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.649258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d83088e1b545b29cc4d0d0868e37c3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:10.652575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:10.689418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aef63d-829a-4103-83be-151d04ef7769 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:10.696611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b2f89-9113-497e-bce4-183654e6fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:10.697265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2f89-9113-497e-bce4-183654e6fdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.697859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2f89-9113-497e-bce4-183654e6fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.698104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2f89-9113-497e-bce4-183654e6fdfa admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.699856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b2f89-9113-497e-bce4-183654e6fdfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:10.702664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b2f89-9113-497e-bce4-183654e6fdfa admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:10.732789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 892/1792] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:10 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:10.735382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21d520-1f77-405c-8dcb-a7875f473a2e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.736134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21d520-1f77-405c-8dcb-a7875f473a2e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.736134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21d520-1f77-405c-8dcb-a7875f473a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.737256 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d83088e1b545b29cc4d0d0868e37c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.746221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d83088e1b545b29cc4d0d0868e37c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.747443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d83088e1b545b29cc4d0d0868e37c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.758228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d83088e1b545b29cc4d0d0868e37c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.760236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1d21d520-1f77-405c-8dcb-a7875f473a2e None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:10.761184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d83088e1b545b29cc4d0d0868e37c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:10.761684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1d21d520-1f77-405c-8dcb-a7875f473a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:10.799177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 901/1793] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:10 2022] DELETE /identity/v3/users/53d83088e1b545b29cc4d0d0868e37c3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:10.800245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.803445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:10.806514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:10.901916 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 893/1794] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 09:57:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:10.919294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0852c39-9bd1-4e5e-9bd1-ce4c1df275fc admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:10.924129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:10.924800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.925086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.925365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.926622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:10.928240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:10.940554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 902/1795] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:10.944443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21d520-1f77-405c-8dcb-a7875f473a2e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.956245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21d520-1f77-405c-8dcb-a7875f473a2e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:10.962422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ddaf3-4ac0-4f72-bc97-8c5d9f08f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:10.963379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddaf3-4ac0-4f72-bc97-8c5d9f08f13b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:10.963744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddaf3-4ac0-4f72-bc97-8c5d9f08f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:10.964393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddaf3-4ac0-4f72-bc97-8c5d9f08f13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:10.964986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ddaf3-4ac0-4f72-bc97-8c5d9f08f13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:10.966651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ddaf3-4ac0-4f72-bc97-8c5d9f08f13b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:10.981475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 894/1796] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:10.983268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:10.995827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73055e0-9f37-486a-9e18-d7ef245053dd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.000151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.001147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.001493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.001896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] PATH_INFO: `/v3/projects/532f2ab1cfbd4494a2cb4f6d66469dbd/users/0b0ff8555ae344c5ba2a65c8c2950c5a/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.022021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] RBAC: Authorizing `identity:create_grant(project_id=532f2ab1cfbd4494a2cb4f6d66469dbd, user_id=0b0ff8555ae344c5ba2a65c8c2950c5a, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.025023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.042547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 903/1797] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:10 2022] PUT /identity/v3/projects/532f2ab1cfbd4494a2cb4f6d66469dbd/users/0b0ff8555ae344c5ba2a65c8c2950c5a/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:11.053315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d27e4-7de6-4fec-bcd2-1fbe063dbde9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.053679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d27e4-7de6-4fec-bcd2-1fbe063dbde9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.054009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d27e4-7de6-4fec-bcd2-1fbe063dbde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.102113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-263d27e4-7de6-4fec-bcd2-1fbe063dbde9 None None] MFA Rules not processed for user `0b0ff8555ae344c5ba2a65c8c2950c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:11.103358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-263d27e4-7de6-4fec-bcd2-1fbe063dbde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:11.184370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:11.187093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:11.223047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 895/1798] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:11.224331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d27e4-7de6-4fec-bcd2-1fbe063dbde9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:11.244862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:11.305095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61464b0-3ca4-461f-a1fe-503d19b2455a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.315084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.315971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.316372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.316958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.330705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.331807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.332772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d27e4-7de6-4fec-bcd2-1fbe063dbde9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.339634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.339873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.340214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.340557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.341328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.343432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.373385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 904/1799] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:11.397795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 896/1800] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:11 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:11.400155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:11.415497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476b62c-4b03-4288-9708-265a913975c1 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.564314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.565277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.570483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.571374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.573113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.575885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.602556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 905/1801] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:11 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:11.606703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:11.644835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848e314-e96c-400e-ad55-3618ab0410cc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.651436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.652763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.653207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.653659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.655667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.657585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.700979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 897/1802] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:11.704314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:11.718119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69d8e0-2b4e-48b6-9ff7-bf0ed065a479 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.751763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.754502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.754882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.755292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] PATH_INFO: `/v3/projects/4d1aaafe2164433caac20707053ea118/users/e427d58c7193444b8b54d03bfc827837/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.786011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1aaafe2164433caac20707053ea118, user_id=e427d58c7193444b8b54d03bfc827837, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.797313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.823991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 906/1803] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:11 2022] PUT /identity/v3/projects/4d1aaafe2164433caac20707053ea118/users/e427d58c7193444b8b54d03bfc827837/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:11.827793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:11.840804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7063f-5bcc-4f8e-9bbb-720a6bb029b6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.865111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:11.925248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede121-5a0c-48c2-a602-da14bc24d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.926014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede121-5a0c-48c2-a602-da14bc24d6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.926308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede121-5a0c-48c2-a602-da14bc24d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.926595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede121-5a0c-48c2-a602-da14bc24d6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.928155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ede121-5a0c-48c2-a602-da14bc24d6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.930945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ede121-5a0c-48c2-a602-da14bc24d6e8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.949453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 898/1804] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:11.951713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:11.965276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60e792-1f24-49a6-ae88-f03038d63437 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:11.971220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:11.972250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:11.972587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:11.973007 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] PATH_INFO: `/v3/projects/4d1aaafe2164433caac20707053ea118/users/e427d58c7193444b8b54d03bfc827837/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:11.976884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1aaafe2164433caac20707053ea118, user_id=e427d58c7193444b8b54d03bfc827837, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:11.980044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:11.993286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 907/1805] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:11 2022] PUT /identity/v3/projects/4d1aaafe2164433caac20707053ea118/users/e427d58c7193444b8b54d03bfc827837/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:12.005529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.005824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.006113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.026397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:12.028161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:12.046089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] MFA Rules not processed for user `e427d58c7193444b8b54d03bfc827837`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:12.048136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:12.133086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72723a84-441c-47e6-a0cd-69364dea7004 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:12.144093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:12.145271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.145791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.146180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] PATH_INFO: `/v3/projects/af56505f91cb4fc6bf70a865487e04f9` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.149318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af56505f91cb4fc6bf70a865487e04f9)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:12.152293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:12.162981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:12.201992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 899/1806] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:12.215461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:12.220837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:12.241868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af56505f91cb4fc6bf70a865487e04f9', 'request_id': 'req-eba6e545-890a-4411-830e-7ace323e5fa5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:12.250258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af56505f91cb4fc6bf70a865487e04f9', 'request_id': 'req-eba6e545-890a-4411-830e-7ace323e5fa5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:12.264958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af56505f91cb4fc6bf70a865487e04f9', 'request_id': 'req-eba6e545-890a-4411-830e-7ace323e5fa5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:12.286259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] The token cache is being invalidate because project af56505f91cb4fc6bf70a865487e04f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:12.286504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:12.287987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eba6e545-890a-4411-830e-7ace323e5fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:12.290643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 908/1807] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:12 2022] DELETE /identity/v3/projects/af56505f91cb4fc6bf70a865487e04f9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:12.308616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1e19-66fb-4306-890e-4afa280820e4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.308960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1e19-66fb-4306-890e-4afa280820e4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.309290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1e19-66fb-4306-890e-4afa280820e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.330275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c17e2f-7bc7-4db2-851b-a0ac7e7838d7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:12.336411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-518a1e19-66fb-4306-890e-4afa280820e4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:12.337619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-518a1e19-66fb-4306-890e-4afa280820e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:12.477998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:12.478997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.479467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.479826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.482068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:12.514071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 909/1808] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:12.515643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb054-0bb0-448b-b0c3-76f802ae2828 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.516931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb054-0bb0-448b-b0c3-76f802ae2828 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.516931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb054-0bb0-448b-b0c3-76f802ae2828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.520159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:12.573088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-588cb054-0bb0-448b-b0c3-76f802ae2828 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:12.574524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-588cb054-0bb0-448b-b0c3-76f802ae2828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:12.606890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 910/1809] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:12.610920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb054-0bb0-448b-b0c3-76f802ae2828 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:12.625251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb054-0bb0-448b-b0c3-76f802ae2828 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:12.630911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:12.633665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:12.646550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:12.647771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.648461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.649776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.651146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:12.651146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:12.652799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:12.656050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 900/1810] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:12.674128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 911/1811] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:57:12.675312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:12.687374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b982-e0c2-42f2-bbdf-3428e41d0a83 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:12.694265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:12.695278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.695391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.695656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.696484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:12.700789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:12.783795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 901/1812] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:12 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:12.785259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:12.799992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412392c5-915e-4779-ad34-e9ee12e6b636 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:12.912277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:12.913056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:12.913323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:12.913606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:12.914553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:12.916595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:12.980251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 912/1813] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:12 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:12.982210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.001021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6a8e-af80-4408-9b0e-30e8a706bce3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.021891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.023923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.024212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.026696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.027479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:13.038210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:13.047561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.049542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:13.064409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:13.071856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 902/1814] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:13.074798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a83388-9c20-488a-af4f-59afd6242bc1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.076317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.090525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.091424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.091709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.091999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] PATH_INFO: `/v3/users/09c82a592bf948019df33a5f3deeee3f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.093965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c82a592bf948019df33a5f3deeee3f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:13.096430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09add9-a2f3-40d9-a318-23d5e0717886 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.096797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:13.107889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.108568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.108855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.109376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.111232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:13.112772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:13.136337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 903/1815] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:13.140763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.167364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d661421-3467-4d5a-8d79-345b5338f3e2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.189096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f156d5-a718-4510-8929-d7bbdd6328ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.197418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f156d5-a718-4510-8929-d7bbdd6328ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.197795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f156d5-a718-4510-8929-d7bbdd6328ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.199726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f156d5-a718-4510-8929-d7bbdd6328ef admin admin] PATH_INFO: `/v3/projects/c319138946e14edd853f05bbba301ce3/users/8f4840d1142449c891395a4d6cef608f/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.205922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c82a592bf948019df33a5f3deeee3f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:13.232535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c82a592bf948019df33a5f3deeee3f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:13.233389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c82a592bf948019df33a5f3deeee3f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:13.249305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c82a592bf948019df33a5f3deeee3f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:13.249980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93efdc0c-8da2-4080-ba56-e92d59abb47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c82a592bf948019df33a5f3deeee3f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:13.263124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f156d5-a718-4510-8929-d7bbdd6328ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c319138946e14edd853f05bbba301ce3, user_id=8f4840d1142449c891395a4d6cef608f, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:13.274249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f156d5-a718-4510-8929-d7bbdd6328ef admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:13.291664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 913/1816] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:13 2022] DELETE /identity/v3/users/09c82a592bf948019df33a5f3deeee3f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:13.302479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.302727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.303014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.314459 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 904/1817] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:13 2022] PUT /identity/v3/projects/c319138946e14edd853f05bbba301ce3/users/8f4840d1142449c891395a4d6cef608f/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:13.318645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.318949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.319238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.328119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:13.331057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:13.365434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] MFA Rules not processed for user `8f4840d1142449c891395a4d6cef608f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:13.367252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:13.467989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 914/1818] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:13.486200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 905/1819] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:13.488465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.490232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:13.597706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4e09b-1025-4963-8ed2-f56c48dca427 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.623168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.630606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.630606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.630606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.630606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:13.638235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:13.643782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.648031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:13.725487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 915/1820] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:13 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:13.725977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:13.729511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.822786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74836d68-2038-4b35-af93-ed1bfd553410 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.851128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:13.855648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a279-b242-48d9-ae13-5e8f44196d2f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.866230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.867344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.867965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.868284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.869553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:13.872782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:13.906013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 916/1821] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:13 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:13.910937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.927820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc203c6-61cc-4310-a11d-5f3f56159cb5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:13.937075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.940285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.943405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.943743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.944541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:13.946475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:13.968395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 917/1822] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:13.976559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:13.987017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:13.987729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:13.988112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:13.988384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:13.993789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5668816-1ea4-4879-a8d6-522983f241d6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:14.005996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:14.007172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.008963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.009227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] PATH_INFO: `/v3/projects/f6defaec5faa4278858bff350f7586e6/users/548532f300ee4aed8b266c3a11691f26/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.009592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.011193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.023687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 906/1823] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:14.041017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6defaec5faa4278858bff350f7586e6, user_id=548532f300ee4aed8b266c3a11691f26, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.044541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.068823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 918/1824] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:13 2022] PUT /identity/v3/projects/f6defaec5faa4278858bff350f7586e6/users/548532f300ee4aed8b266c3a11691f26/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:14.069786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:14.085644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ff3b-95ef-445e-9864-7774b2b8d95b service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:14.187605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73e349-82d1-45d2-a206-b0ae47876b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:14.188888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73e349-82d1-45d2-a206-b0ae47876b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.189351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73e349-82d1-45d2-a206-b0ae47876b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.189642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73e349-82d1-45d2-a206-b0ae47876b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.190402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73e349-82d1-45d2-a206-b0ae47876b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.191999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73e349-82d1-45d2-a206-b0ae47876b7b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.206878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 907/1825] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:14.209220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:14.232953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c83fa3-2dce-4225-9c7c-ee4f9b3f2084 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:14.240382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:14.241470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.242116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.242600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] PATH_INFO: `/v3/projects/f6defaec5faa4278858bff350f7586e6/users/548532f300ee4aed8b266c3a11691f26/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.253014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6defaec5faa4278858bff350f7586e6, user_id=548532f300ee4aed8b266c3a11691f26, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.253014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.268790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 919/1826] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:14 2022] PUT /identity/v3/projects/f6defaec5faa4278858bff350f7586e6/users/548532f300ee4aed8b266c3a11691f26/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:14.278858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.279345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.279933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.311069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] MFA Rules not processed for user `548532f300ee4aed8b266c3a11691f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:14.312583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:14.416496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 908/1827] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:14.430772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:14.433688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:14.446664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:14.448073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:14.462488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:14.518834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d78dd-7395-4b60-97f1-c466a3ebf375 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:14.522251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23266d8-8dc8-4c42-ab6e-f2e4a24752f2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:14.522735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:14.523063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.523347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.523627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.529249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:14.531166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.531388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.531667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] PATH_INFO: `/v3/projects/f7676e81a902486094ce23edbc695eec` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.532900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7676e81a902486094ce23edbc695eec)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.534908 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.542663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.544105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.560751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 909/1828] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:14.602028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7676e81a902486094ce23edbc695eec', 'request_id': 'req-266cdda2-f635-4519-9560-e816d16fa2be'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.614523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7676e81a902486094ce23edbc695eec', 'request_id': 'req-266cdda2-f635-4519-9560-e816d16fa2be'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.631566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7676e81a902486094ce23edbc695eec', 'request_id': 'req-266cdda2-f635-4519-9560-e816d16fa2be'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.646543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] The token cache is being invalidate because project f7676e81a902486094ce23edbc695eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:14.648105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.648994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.652655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 920/1829] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:14 2022] DELETE /identity/v3/projects/f7676e81a902486094ce23edbc695eec => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:14.659016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:14.669433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f82af-958e-44ef-af9a-1f91eb1ab36e service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:14.682495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:14.684526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:14.727104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:14.769121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdda2-f635-4519-9560-e816d16fa2be admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:14.774336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:14.775412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.776344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.776824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.781363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:14.800364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:14.807273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:14.807699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:14.808083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] PATH_INFO: `/v3/users/49b8a02c1a0f4c86bdba88373a7e0e43` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:14.809742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b8a02c1a0f4c86bdba88373a7e0e43)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.813815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.912544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:14.916946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:14.931185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b8a02c1a0f4c86bdba88373a7e0e43'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.940167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 921/1830] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:14.945342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b8a02c1a0f4c86bdba88373a7e0e43'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.945889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b8a02c1a0f4c86bdba88373a7e0e43'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.955752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b8a02c1a0f4c86bdba88373a7e0e43'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.956492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b8a02c1a0f4c86bdba88373a7e0e43'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:14.984172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 910/1831] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:14 2022] DELETE /identity/v3/users/49b8a02c1a0f4c86bdba88373a7e0e43 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:15.368370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:15.369788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:15.406143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc615-f359-4750-9b4e-0dcc0a4c131b service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:15.491311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:15.493254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:15.493789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:15.494184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] PATH_INFO: `/v3/users/8f4840d1142449c891395a4d6cef608f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:15.497015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4840d1142449c891395a4d6cef608f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:15.500080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:15.592369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4840d1142449c891395a4d6cef608f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.606219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:15.608890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:15.618378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4840d1142449c891395a4d6cef608f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.620249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4840d1142449c891395a4d6cef608f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.632383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59869-f3ea-4b24-8159-9fef6363947b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:15.634975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4840d1142449c891395a4d6cef608f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.636007 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b1336a0-7160-41ce-97c3-6d19d94bc4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4840d1142449c891395a4d6cef608f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.639185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:15.640394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:15.640394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:15.640666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] PATH_INFO: `/v3/users/0b0ff8555ae344c5ba2a65c8c2950c5a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:15.642528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0ff8555ae344c5ba2a65c8c2950c5a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:15.645241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:15.655269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:15.666266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 922/1832] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:15 2022] DELETE /identity/v3/users/8f4840d1142449c891395a4d6cef608f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:15.671512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:15.671913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:15.672266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:15.692293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:15.704127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:15.706043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:15.783203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0ff8555ae344c5ba2a65c8c2950c5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.787605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 923/1833] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:15.795630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0ff8555ae344c5ba2a65c8c2950c5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.796356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0ff8555ae344c5ba2a65c8c2950c5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.804642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:15.807405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:15.808529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0ff8555ae344c5ba2a65c8c2950c5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.809516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb5d2e13-9eb6-45e8-9f15-5832f3b32cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0ff8555ae344c5ba2a65c8c2950c5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:15.834174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 911/1834] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:15 2022] DELETE /identity/v3/users/0b0ff8555ae344c5ba2a65c8c2950c5a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:15.838979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:15.839518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:15.839999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:15.890842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:15.893272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:15.929367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74150c3-44d1-4a86-86a5-deabe52b4c85 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.016586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 912/1835] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:16.019787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.020709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.021318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.023107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.025369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.040501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.042059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.054316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.055971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.057297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4aaf9-b28b-4b1e-82e8-7a2e578e135c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.066701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da812fa0-a7fe-4e1d-b054-1d56b20a23cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.067382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da812fa0-a7fe-4e1d-b054-1d56b20a23cd service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.067671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da812fa0-a7fe-4e1d-b054-1d56b20a23cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.067960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da812fa0-a7fe-4e1d-b054-1d56b20a23cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.068054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 924/1836] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:16.068955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.070347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.080684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da812fa0-a7fe-4e1d-b054-1d56b20a23cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.082614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da812fa0-a7fe-4e1d-b054-1d56b20a23cd service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.087139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8258bbd-bd60-4378-9262-113e99cc461a service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.098199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.098970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.099262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.099649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] PATH_INFO: `/v3/projects/e99e872b7ff640cdb8888089b099e578` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.100882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99e872b7ff640cdb8888089b099e578)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.102223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 913/1837] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:16.103268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.173247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99e872b7ff640cdb8888089b099e578', 'request_id': 'req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.178327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:16.184226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99e872b7ff640cdb8888089b099e578', 'request_id': 'req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.193990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99e872b7ff640cdb8888089b099e578', 'request_id': 'req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.207506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] The token cache is being invalidate because project e99e872b7ff640cdb8888089b099e578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:16.207794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.208772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fe69b5ec-65aa-4ac3-9017-46ff2171f08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.211357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 925/1838] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:16 2022] DELETE /identity/v3/projects/e99e872b7ff640cdb8888089b099e578 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:16.216254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.216675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.216975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.239854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:16.241110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.353332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 914/1839] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:16.362514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab92917-cf43-4c8c-a8d4-2323dd9f938b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.362809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab92917-cf43-4c8c-a8d4-2323dd9f938b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.363180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab92917-cf43-4c8c-a8d4-2323dd9f938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.386896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0ab92917-cf43-4c8c-a8d4-2323dd9f938b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:16.389885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0ab92917-cf43-4c8c-a8d4-2323dd9f938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.403321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 926/1840] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:16.405856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.408329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab92917-cf43-4c8c-a8d4-2323dd9f938b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.409982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.418572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab92917-cf43-4c8c-a8d4-2323dd9f938b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.430944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.431684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.431973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.432250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.432992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:16.433300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.435203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.441930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c0e04-6d95-4c35-b844-9502474b5ac5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.446877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.447818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.448136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.448420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] PATH_INFO: `/v3/projects/c319138946e14edd853f05bbba301ce3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.449673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c319138946e14edd853f05bbba301ce3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.451819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.458064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 927/1841] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:57:16.458910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.460686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.474223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c8c5-685c-402c-b055-b32dbb5d4512 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.480205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.481152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.481498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.481882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] PATH_INFO: `/v3/projects/532f2ab1cfbd4494a2cb4f6d66469dbd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.482357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:16.485135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532f2ab1cfbd4494a2cb4f6d66469dbd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.487593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.508398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c319138946e14edd853f05bbba301ce3', 'request_id': 'req-370c784d-3180-42a8-bae5-626a563b7aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.514683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c319138946e14edd853f05bbba301ce3', 'request_id': 'req-370c784d-3180-42a8-bae5-626a563b7aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.521161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c319138946e14edd853f05bbba301ce3', 'request_id': 'req-370c784d-3180-42a8-bae5-626a563b7aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.539039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] The token cache is being invalidate because project c319138946e14edd853f05bbba301ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:16.539325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.539958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.541576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 915/1842] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:16 2022] DELETE /identity/v3/projects/c319138946e14edd853f05bbba301ce3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:16.542441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.543776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.552666 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532f2ab1cfbd4494a2cb4f6d66469dbd', 'request_id': 'req-e6d50898-cc6f-4df4-a6c3-c6215b555497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.558555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532f2ab1cfbd4494a2cb4f6d66469dbd', 'request_id': 'req-e6d50898-cc6f-4df4-a6c3-c6215b555497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.566792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532f2ab1cfbd4494a2cb4f6d66469dbd', 'request_id': 'req-e6d50898-cc6f-4df4-a6c3-c6215b555497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.580585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] The token cache is being invalidate because project 532f2ab1cfbd4494a2cb4f6d66469dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:16.580839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.581534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.586383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 928/1843] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:16 2022] DELETE /identity/v3/projects/532f2ab1cfbd4494a2cb4f6d66469dbd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:16.586383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.586383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.619328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c784d-3180-42a8-bae5-626a563b7aae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.670873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50898-cc6f-4df4-a6c3-c6215b555497 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.677432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.678096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.678336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.678847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.679510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.679624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.679624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.680025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] PATH_INFO: `/v3/users/548532f300ee4aed8b266c3a11691f26` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.680217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.681266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] RBAC: Authorizing `identity:delete_user(user_id=548532f300ee4aed8b266c3a11691f26)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.682438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.683283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.716186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 916/1844] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:16 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:16.717194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.719273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.743922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548532f300ee4aed8b266c3a11691f26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.745169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:16.752380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548532f300ee4aed8b266c3a11691f26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.753214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548532f300ee4aed8b266c3a11691f26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.761936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548532f300ee4aed8b266c3a11691f26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.762617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548532f300ee4aed8b266c3a11691f26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.776955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:16.784026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 929/1845] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:16 2022] DELETE /identity/v3/users/548532f300ee4aed8b266c3a11691f26 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:16.784758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.787288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:16.812491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57acb67-acc9-485e-813a-7c7e08c7be07 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.894367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7184-fcaa-463a-bb94-cb44ab2caece admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.900423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.900672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.901036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.901390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.902204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.904354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.906342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.907975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.908458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.908920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] PATH_INFO: `/v3/users/e427d58c7193444b8b54d03bfc827837` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.910325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e427d58c7193444b8b54d03bfc827837)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.912430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.933595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 930/1846] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:16 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:16.934277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.948277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c07371-1470-4b2a-9cd3-37cecbb4c413 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:16.956034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:16.956717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:16.957547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:16.957918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:16.958658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:16.963088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:16.975533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e427d58c7193444b8b54d03bfc827837'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.980281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 931/1847] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:16.984568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:16.986121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e427d58c7193444b8b54d03bfc827837'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:16.987120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e427d58c7193444b8b54d03bfc827837'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.005413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd28a-34ff-49a5-a860-6eb9bf9e1a23 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.012530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.013853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.014279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.015038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.015991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.018521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.032211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e427d58c7193444b8b54d03bfc827837'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.033455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-48b1e14e-7081-4da1-91c6-063ec606e883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e427d58c7193444b8b54d03bfc827837'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.037653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 932/1848] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:17.042056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.047165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.069683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248b04b-f2f0-471a-8daf-dd03850d409f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.074012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 917/1849] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:16 2022] DELETE /identity/v3/users/e427d58c7193444b8b54d03bfc827837 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:17.078777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.079822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.080143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.080422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] PATH_INFO: `/v3/projects/a27b10ab52bf40a0bcf253f21f9e344e/users/cca4ab9101dc4e76ac101d83ed0d9ab9/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.103001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27b10ab52bf40a0bcf253f21f9e344e, user_id=cca4ab9101dc4e76ac101d83ed0d9ab9, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.105838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.121240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 933/1850] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:17 2022] PUT /identity/v3/projects/a27b10ab52bf40a0bcf253f21f9e344e/users/cca4ab9101dc4e76ac101d83ed0d9ab9/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:17.126719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.127083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.127446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.146516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:17.147816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.187285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.189818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.260359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 918/1851] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:17.272165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.274294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.282011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76bfc-3d01-4b16-a84c-d5b313d5999c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.288030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.289217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.289510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.289861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] PATH_INFO: `/v3/projects/f6defaec5faa4278858bff350f7586e6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.290893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:17.291867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6defaec5faa4278858bff350f7586e6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.294192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.307349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:17.343766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894d682-c93e-460f-894a-c9311ba6bb82 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.351266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6defaec5faa4278858bff350f7586e6', 'request_id': 'req-99edd922-2608-4b5a-829c-6d4715eb3a4e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.356961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6defaec5faa4278858bff350f7586e6', 'request_id': 'req-99edd922-2608-4b5a-829c-6d4715eb3a4e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.366564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6defaec5faa4278858bff350f7586e6', 'request_id': 'req-99edd922-2608-4b5a-829c-6d4715eb3a4e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.379946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] The token cache is being invalidate because project f6defaec5faa4278858bff350f7586e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:17.380866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.381175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-99edd922-2608-4b5a-829c-6d4715eb3a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.385805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 934/1852] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:17 2022] DELETE /identity/v3/projects/f6defaec5faa4278858bff350f7586e6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:17.387763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8601-2fba-4324-8955-69e47f8e83d9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.390056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8601-2fba-4324-8955-69e47f8e83d9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.390375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8601-2fba-4324-8955-69e47f8e83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.417272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f9ff8601-2fba-4324-8955-69e47f8e83d9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:17.419039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f9ff8601-2fba-4324-8955-69e47f8e83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.432265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.432938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.433226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.433511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.435861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.498428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 935/1853] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:17.506257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.506649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.507113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.510520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.512290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.524873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 919/1854] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:17.527914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:17.529296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.538294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 936/1855] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:17.542708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.544958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.546576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.554502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217229-b72c-44e0-9994-b4150178eee8 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.559152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb865e4-85c4-48ff-a3b8-0f40bd5af3fc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.560037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.561051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.561350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.561641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.562410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:17.563602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.566401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.566819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.567907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.569114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.569593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] PATH_INFO: `/v3/projects/4d1aaafe2164433caac20707053ea118` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.571334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1aaafe2164433caac20707053ea118)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.573676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.584976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 920/1856] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:57:17.589155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.601018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540a4a5-5e4f-492b-8660-503e5b9f53f5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.606575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.607252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.607544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.607828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.608536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.610532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.640183 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 921/1857] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:17.641047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1aaafe2164433caac20707053ea118', 'request_id': 'req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.644937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.650570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1aaafe2164433caac20707053ea118', 'request_id': 'req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.659393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1aaafe2164433caac20707053ea118', 'request_id': 'req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.673416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] The token cache is being invalidate because project 4d1aaafe2164433caac20707053ea118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:17.674109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.674633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fdac7775-1c3a-4ac2-b4bd-04d5c60b81ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:17.676564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 937/1858] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:17 2022] DELETE /identity/v3/projects/4d1aaafe2164433caac20707053ea118 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:17.681547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a8ff-3085-47bf-9521-2f1eef4365a5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.681876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a8ff-3085-47bf-9521-2f1eef4365a5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.682170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a8ff-3085-47bf-9521-2f1eef4365a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.695273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:17.702507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-02b1a8ff-3085-47bf-9521-2f1eef4365a5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:17.704587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-02b1a8ff-3085-47bf-9521-2f1eef4365a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.715870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:17.720904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f5d6-f839-4548-b6a9-4f0f01f0ece3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.726394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.727145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.727598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.728195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.728783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.731300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.756851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 922/1859] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:17.762403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.763933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.778432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865ed65-b6b1-4686-8692-85d5b1d82cf7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.784167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.785027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.785498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.785939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.786768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.788665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.804880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 923/1860] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:17.806120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.814771 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 938/1861] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:17.817188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25b3e5-7ffe-40a1-8972-2354708c082b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.817994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25b3e5-7ffe-40a1-8972-2354708c082b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.818633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25b3e5-7ffe-40a1-8972-2354708c082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.820828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7a8e6-b7f5-4cd4-b462-d5e481b281bd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.826117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.826846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.827138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.827424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.828231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.829950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.844591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 924/1862] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:17.846355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.848876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1c25b3e5-7ffe-40a1-8972-2354708c082b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:17.850474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1c25b3e5-7ffe-40a1-8972-2354708c082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:17.860269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4618a-7229-48c1-8c7e-9f7c2ef39d71 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.865645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 939/1863] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:17.867194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25b3e5-7ffe-40a1-8972-2354708c082b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.868711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0bed0-eb1f-40d2-894e-dcfea27e2f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.869700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0bed0-eb1f-40d2-894e-dcfea27e2f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.870090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0bed0-eb1f-40d2-894e-dcfea27e2f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.871317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0bed0-eb1f-40d2-894e-dcfea27e2f85 admin admin] PATH_INFO: `/v3/projects/47107add410244a2a354846d1ca475dc/users/33141207ed054b86b297518452b9ff78/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.879503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25b3e5-7ffe-40a1-8972-2354708c082b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.887161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:17.888894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.889407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.890396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.892121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:17.892717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.893654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0bed0-eb1f-40d2-894e-dcfea27e2f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47107add410244a2a354846d1ca475dc, user_id=33141207ed054b86b297518452b9ff78, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:17.894957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.899882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0bed0-eb1f-40d2-894e-dcfea27e2f85 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:17.919499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 925/1864] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:17 2022] PUT /identity/v3/projects/47107add410244a2a354846d1ca475dc/users/33141207ed054b86b297518452b9ff78/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:17.928190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 940/1865] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:57:17.929779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a551-a7a8-456c-8d93-156ef4ce0c2e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:17.930187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a551-a7a8-456c-8d93-156ef4ce0c2e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:17.930590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a551-a7a8-456c-8d93-156ef4ce0c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:17.932844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:17.943348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea63d4e-6009-4de4-ae91-0688f93a796a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:17.975105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ec13a551-a7a8-456c-8d93-156ef4ce0c2e None None] MFA Rules not processed for user `33141207ed054b86b297518452b9ff78`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:17.976333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ec13a551-a7a8-456c-8d93-156ef4ce0c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:18.034789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:18.035752 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.036043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.036327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.038157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:18.042788 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:18.089524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 926/1866] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:18.093463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 941/1867] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:17 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:18.099179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a551-a7a8-456c-8d93-156ef4ce0c2e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.102907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.105117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:18.114833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a551-a7a8-456c-8d93-156ef4ce0c2e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:18.183945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303f08d-1838-4a94-946c-dea31c9da44d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:18.188448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:18.188662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:18.189274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.189381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.189557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.189647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.189878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.189975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.190680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:18.193956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:18.243412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 927/1868] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:18 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:18.249214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.254849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:18.271221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:18.280341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0999b9-2a89-4174-897c-56420210cc18 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:18.293059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:18.293693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:18.295418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:18.295952 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.296243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.296522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.297361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:18.300945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:18.306980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 942/1869] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:18.331313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.335508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 928/1870] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:18.350045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f46b0-896b-4a38-bdb5-aaac456807c5 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:18.356237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95a29-3e6f-4a85-af7b-6e87a5bacfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:18.357341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95a29-3e6f-4a85-af7b-6e87a5bacfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.357903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95a29-3e6f-4a85-af7b-6e87a5bacfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.358438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95a29-3e6f-4a85-af7b-6e87a5bacfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.359448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95a29-3e6f-4a85-af7b-6e87a5bacfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:18.362449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95a29-3e6f-4a85-af7b-6e87a5bacfa4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:18.379693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 943/1871] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:18.381512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.394693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bded-cbf7-4517-b3a2-4f5414fb38ca admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:18.400174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:18.401247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.401535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.402028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] PATH_INFO: `/v3/projects/6c849face14a491f8ad7e6d72c3dabe5/users/005aa46e83eb4627bd157f7eddc04909/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.423221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c849face14a491f8ad7e6d72c3dabe5, user_id=005aa46e83eb4627bd157f7eddc04909, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:18.426441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:18.449883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 929/1872] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:18 2022] PUT /identity/v3/projects/6c849face14a491f8ad7e6d72c3dabe5/users/005aa46e83eb4627bd157f7eddc04909/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:18.454694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfdaf-8b89-41a5-8759-59ab1d47fbc2 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.455119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfdaf-8b89-41a5-8759-59ab1d47fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.455507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfdaf-8b89-41a5-8759-59ab1d47fbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.488018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-401cfdaf-8b89-41a5-8759-59ab1d47fbc2 None None] MFA Rules not processed for user `005aa46e83eb4627bd157f7eddc04909`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:18.489131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-401cfdaf-8b89-41a5-8759-59ab1d47fbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:18.632960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 944/1873] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:18.639769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.758428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.758997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.759243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.814580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2c245-4828-431b-86af-333e1171104f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:18.820131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:18.822519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:18.822519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:18.822519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:18.823552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:18.825424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:18.833252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] MFA Rules not processed for user `cca4ab9101dc4e76ac101d83ed0d9ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:18.838352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:18.870735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 930/1874] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:18 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:18.876172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.963599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 945/1875] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:18.964703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:18.969777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:18.997472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce8543-0fcc-4e83-b266-1e1e586f6d07 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.047449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9c8b-7366-469f-a65e-27249b6207e9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.062536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.063957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.064441 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.064804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.065527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.069485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.089802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:19.120155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 931/1876] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:18 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:19.124162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.133679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.134924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.135407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.135827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.139745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.143461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fba23c-0146-4e97-82ff-15aa8e96bded admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.145429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.156945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.158889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.159524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.160138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.162018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.165272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.182640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 946/1877] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:18 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:19.184828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 932/1878] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:19.186916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.191133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.204880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681c372-7559-42ae-abf9-f319abdd5bd7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.241102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:19.284776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.285716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.286039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.286323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] PATH_INFO: `/v3/projects/e79cbef7f9104c21834e6ed57b80e236/users/eb0c682ababc46d7a81e6e8df1dc450f/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.294391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5597c8-4a88-4272-86e8-81862b18069b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.303434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.304124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.304231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79cbef7f9104c21834e6ed57b80e236, user_id=eb0c682ababc46d7a81e6e8df1dc450f, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.304422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.304750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.305462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.306900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.307635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.326575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 933/1879] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:19 2022] PUT /identity/v3/projects/e79cbef7f9104c21834e6ed57b80e236/users/eb0c682ababc46d7a81e6e8df1dc450f/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:19.330651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.331244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 947/1880] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:19 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:19.334834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.350423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc247b9-0e26-49ed-bed1-973f4ba9a71a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.416961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acebb8-7f81-4700-9028-d130f2925de0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.417954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.418818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.419114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.419526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.420370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.421743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.422244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.422971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.423257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.423532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.426773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.428359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.434291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 948/1881] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:19.443350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 934/1882] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:19.443476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.444410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.452947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c3f4-b2e1-47f2-93fd-3070b9b23eaf admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.454462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859c278-03b8-472c-88f2-4254b59eb6fb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.458825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.459074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bad555-acae-4833-ae1d-229ad8eb1244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.459945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bad555-acae-4833-ae1d-229ad8eb1244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.460047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.460235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bad555-acae-4833-ae1d-229ad8eb1244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.460332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.460516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bad555-acae-4833-ae1d-229ad8eb1244 admin admin] PATH_INFO: `/v3/projects/e79cbef7f9104c21834e6ed57b80e236/users/eb0c682ababc46d7a81e6e8df1dc450f/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.460629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] PATH_INFO: `/v3/projects/5c0ac1acdb6b4785bbcd4366070a0591/users/d0c1e33107e34e26a59a8e065163457b/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.462621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bad555-acae-4833-ae1d-229ad8eb1244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79cbef7f9104c21834e6ed57b80e236, user_id=eb0c682ababc46d7a81e6e8df1dc450f, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.465270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bad555-acae-4833-ae1d-229ad8eb1244 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.476708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 935/1883] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:19 2022] PUT /identity/v3/projects/e79cbef7f9104c21834e6ed57b80e236/users/eb0c682ababc46d7a81e6e8df1dc450f/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:19.477852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0ac1acdb6b4785bbcd4366070a0591, user_id=d0c1e33107e34e26a59a8e065163457b, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.480515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.487207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.487505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.487791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.496373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 949/1884] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:19 2022] PUT /identity/v3/projects/5c0ac1acdb6b4785bbcd4366070a0591/users/d0c1e33107e34e26a59a8e065163457b/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:19.500148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.519440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] MFA Rules not processed for user `eb0c682ababc46d7a81e6e8df1dc450f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:19.520762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:19.536655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:19.569061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18c80e-855f-41a0-967e-ef2bf68800af admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.574057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.574724 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.575126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.575413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.576143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.577768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.587732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 950/1885] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:19.591010 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 936/1886] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:19.591797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.601579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af9ec-2f8c-4abb-8c16-55c5ac666264 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.606279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.607163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.607453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.607740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] PATH_INFO: `/v3/projects/5c0ac1acdb6b4785bbcd4366070a0591/users/d0c1e33107e34e26a59a8e065163457b/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.608714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.610295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0ac1acdb6b4785bbcd4366070a0591, user_id=d0c1e33107e34e26a59a8e065163457b, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.611124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:19.612981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.624250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 951/1887] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:19 2022] PUT /identity/v3/projects/5c0ac1acdb6b4785bbcd4366070a0591/users/d0c1e33107e34e26a59a8e065163457b/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:19.644833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:19.683862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979839a8-ebe5-4636-835d-f876ba77cf5b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.737707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559ae2-e7eb-499a-8fba-087d8ee45d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.738561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559ae2-e7eb-499a-8fba-087d8ee45d00 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.738921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559ae2-e7eb-499a-8fba-087d8ee45d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.739197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559ae2-e7eb-499a-8fba-087d8ee45d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:19.832346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52559ae2-e7eb-499a-8fba-087d8ee45d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:19.834824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52559ae2-e7eb-499a-8fba-087d8ee45d00 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:19.858333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 937/1888] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:19.901840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:19.914688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b490cd-074b-4e08-8b75-c79dd1b8ab51 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:19.919449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:19.920206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:19.920564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:19.920922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:20.009123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:20.010614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:20.021012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 952/1889] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:20.419777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76507-4ed7-4d10-bf9b-936f0351114e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:20.420077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76507-4ed7-4d10-bf9b-936f0351114e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:20.420365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76507-4ed7-4d10-bf9b-936f0351114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:20.456043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-07d76507-4ed7-4d10-bf9b-936f0351114e None None] MFA Rules not processed for user `d0c1e33107e34e26a59a8e065163457b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:20.457348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-07d76507-4ed7-4d10-bf9b-936f0351114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:20.541506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 938/1890] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:20.553882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:20.563563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93065af-75b2-4e2b-a88f-a4031b36ab5c service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:20.567672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316807-0eed-4ccf-a2fe-6e42367abd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:20.568424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316807-0eed-4ccf-a2fe-6e42367abd30 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:20.568811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316807-0eed-4ccf-a2fe-6e42367abd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:20.569192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316807-0eed-4ccf-a2fe-6e42367abd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:20.638494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316807-0eed-4ccf-a2fe-6e42367abd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:20.640024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316807-0eed-4ccf-a2fe-6e42367abd30 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:20.651582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 953/1891] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:22.609985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787bd15-2bc0-41b4-a930-a9973ddb7715 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:22.610531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787bd15-2bc0-41b4-a930-a9973ddb7715 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:22.610680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787bd15-2bc0-41b4-a930-a9973ddb7715 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:22.612701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 939/1892] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 09:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:57:22.621928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73e77-b853-45d8-84ef-610906b301c6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:22.622355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73e77-b853-45d8-84ef-610906b301c6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:22.622638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73e77-b853-45d8-84ef-610906b301c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:22.642734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0ef73e77-b853-45d8-84ef-610906b301c6 None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:22.644005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0ef73e77-b853-45d8-84ef-610906b301c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:22.704493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:22.736915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 954/1893] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:22.750997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787bd15-2bc0-41b4-a930-a9973ddb7715 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:22.753050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e787bd15-2bc0-41b4-a930-a9973ddb7715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:22.784111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787bd15-2bc0-41b4-a930-a9973ddb7715 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:22.800982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:22.803122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:22.803122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:22.803122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:22.815408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:22.817059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:22.828528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 940/1894] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:23.140504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef73e77-b853-45d8-84ef-610906b301c6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:23.153950 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef73e77-b853-45d8-84ef-610906b301c6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:23.160414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85427629-bd32-4fd8-9d1c-77e51c3f2c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:23.161286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427629-bd32-4fd8-9d1c-77e51c3f2c94 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:23.161913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427629-bd32-4fd8-9d1c-77e51c3f2c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:23.162346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427629-bd32-4fd8-9d1c-77e51c3f2c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:23.177244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85427629-bd32-4fd8-9d1c-77e51c3f2c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:23.179967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85427629-bd32-4fd8-9d1c-77e51c3f2c94 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:23.199107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 955/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:24.024187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:24.028767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:24.134691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc1518-868c-46ea-b957-2bd7bea42ed7 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:24.145199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:24.146492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:24.147031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:24.147561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] PATH_INFO: `/v3/users/005aa46e83eb4627bd157f7eddc04909` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:24.149046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005aa46e83eb4627bd157f7eddc04909)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:24.151842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:24.223744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005aa46e83eb4627bd157f7eddc04909'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.233246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005aa46e83eb4627bd157f7eddc04909'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.234063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005aa46e83eb4627bd157f7eddc04909'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.243797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005aa46e83eb4627bd157f7eddc04909'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.244652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005aa46e83eb4627bd157f7eddc04909'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.262868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 941/1896] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:24 2022] DELETE /identity/v3/users/005aa46e83eb4627bd157f7eddc04909 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:24.267268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:24.267729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:24.267860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:24.285392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:24.286605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:24.343970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 956/1897] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:24.353496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:24.354926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:24.413297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7265e-1ca7-48e8-addf-1567c4e61dd2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:24.417033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:24.417687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:24.418007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:24.418289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:24.429542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:24.431034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:24.441691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 942/1898] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:24.714924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:24.716572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:24.729498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19b309-3ad4-4083-9dbe-c10dad5cff58 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:24.734128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:24.735699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:24.735985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:24.736263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] PATH_INFO: `/v3/projects/6c849face14a491f8ad7e6d72c3dabe5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:24.737448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c849face14a491f8ad7e6d72c3dabe5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:24.739405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:24.785464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c849face14a491f8ad7e6d72c3dabe5', 'request_id': 'req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.790785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c849face14a491f8ad7e6d72c3dabe5', 'request_id': 'req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.798456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c849face14a491f8ad7e6d72c3dabe5', 'request_id': 'req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.809189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] The token cache is being invalidate because project 6c849face14a491f8ad7e6d72c3dabe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:24.809513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.810132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.811944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 957/1899] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:24 2022] DELETE /identity/v3/projects/6c849face14a491f8ad7e6d72c3dabe5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:24.815694 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:24.825397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef0526-b10e-4a48-b665-fcab994e525c service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:24.844882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:24.884230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:24.885110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:24.885403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:24.885684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] PATH_INFO: `/v3/users/eb0c682ababc46d7a81e6e8df1dc450f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:24.886949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0c682ababc46d7a81e6e8df1dc450f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:24.888893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:24.938994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0c682ababc46d7a81e6e8df1dc450f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.945709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0c682ababc46d7a81e6e8df1dc450f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.946399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0c682ababc46d7a81e6e8df1dc450f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.955175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0c682ababc46d7a81e6e8df1dc450f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.955849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-454018b4-9521-4b60-b019-3535873859e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0c682ababc46d7a81e6e8df1dc450f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:24.973343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 943/1900] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:24 2022] DELETE /identity/v3/users/eb0c682ababc46d7a81e6e8df1dc450f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:25.420026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:25.421639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:25.437162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6bd71-14f7-4859-aca2-0799f3e9cf13 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:25.493437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:25.506740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:25.507671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.507969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.508721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] PATH_INFO: `/v3/projects/e79cbef7f9104c21834e6ed57b80e236` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.510935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79cbef7f9104c21834e6ed57b80e236)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:25.513274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:25.564537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79cbef7f9104c21834e6ed57b80e236', 'request_id': 'req-93719bef-7171-49c1-b64d-66c0f60be8ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:25.570291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79cbef7f9104c21834e6ed57b80e236', 'request_id': 'req-93719bef-7171-49c1-b64d-66c0f60be8ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:25.578077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79cbef7f9104c21834e6ed57b80e236', 'request_id': 'req-93719bef-7171-49c1-b64d-66c0f60be8ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:25.591411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] The token cache is being invalidate because project e79cbef7f9104c21834e6ed57b80e236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:25.591884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:25.592594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93719bef-7171-49c1-b64d-66c0f60be8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:25.594531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 958/1901] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:25 2022] DELETE /identity/v3/projects/e79cbef7f9104c21834e6ed57b80e236 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:25.599554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f502-70db-4706-bef6-5e576e20bee0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.600038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f502-70db-4706-bef6-5e576e20bee0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.600145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f502-70db-4706-bef6-5e576e20bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.617629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b479f502-70db-4706-bef6-5e576e20bee0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:25.618842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b479f502-70db-4706-bef6-5e576e20bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:25.687544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 944/1902] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:25.695786 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e9c3b-7b1e-4b3f-a79a-953718579362 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.696107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e9c3b-7b1e-4b3f-a79a-953718579362 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.696383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e9c3b-7b1e-4b3f-a79a-953718579362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.715101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1c2e9c3b-7b1e-4b3f-a79a-953718579362 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:25.716327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1c2e9c3b-7b1e-4b3f-a79a-953718579362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:25.724652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 959/1903] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:25.728879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479f502-70db-4706-bef6-5e576e20bee0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:25.739121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479f502-70db-4706-bef6-5e576e20bee0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:25.743745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:25.744409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.744696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.744970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.745701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:25.746053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:25.747649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:25.760253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 945/1904] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:57:25.764286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e9c3b-7b1e-4b3f-a79a-953718579362 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:25.774312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e9c3b-7b1e-4b3f-a79a-953718579362 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:25.779186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:25.779828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.780110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.780380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.781326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:25.783850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:25.808682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 960/1905] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:25 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:25.812963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:25.822662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3533-6dbb-4135-b16a-b72c47cfc354 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:25.851617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:25.880712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:25.881397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.881686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.881999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.882687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:25.884608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:25.904550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 946/1906] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:25 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:25.909474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:25.921050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91c08-ff6e-46db-91d1-ed47ad986e02 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:25.926039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:25.926699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.926981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.927257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.927977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:25.929585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:25.939981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 961/1907] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:25.944020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:25.954491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fffd7-36a7-46d9-9a1c-136ae11d8317 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:25.959135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4e0c7-199f-4d50-8fcf-990f2eadffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:25.959788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e0c7-199f-4d50-8fcf-990f2eadffa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.960159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e0c7-199f-4d50-8fcf-990f2eadffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.960387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e0c7-199f-4d50-8fcf-990f2eadffa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:25.961104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4e0c7-199f-4d50-8fcf-990f2eadffa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:25.962734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4e0c7-199f-4d50-8fcf-990f2eadffa4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:25.975200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 947/1908] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:25.979098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:25.988890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49cccc-0d95-4dd9-a429-fb708805ec56 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:25.993483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:25.994384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:25.994675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:25.994958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] PATH_INFO: `/v3/projects/74a976f9ddad4767ad91a96a78f98f1f/users/030fe2c08b4643409bdabcaf04a90949/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.009088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a976f9ddad4767ad91a96a78f98f1f, user_id=030fe2c08b4643409bdabcaf04a90949, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.011758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.024479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 962/1909] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:25 2022] PUT /identity/v3/projects/74a976f9ddad4767ad91a96a78f98f1f/users/030fe2c08b4643409bdabcaf04a90949/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:26.036246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552bba-b651-43f7-a1c1-db144a5e6f7d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.036548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552bba-b651-43f7-a1c1-db144a5e6f7d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.036836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552bba-b651-43f7-a1c1-db144a5e6f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.062138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d0552bba-b651-43f7-a1c1-db144a5e6f7d None None] MFA Rules not processed for user `030fe2c08b4643409bdabcaf04a90949`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:26.063845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d0552bba-b651-43f7-a1c1-db144a5e6f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:26.126082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 948/1910] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:26.130412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.191282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b2b68-4161-480b-8348-71756f9d015e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.195966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.196615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.196905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.197185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.197897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.199805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.225296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 963/1911] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:26 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:26.229406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552bba-b651-43f7-a1c1-db144a5e6f7d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.239917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552bba-b651-43f7-a1c1-db144a5e6f7d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.294458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.295123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.295408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.295684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.296373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.298372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.320469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 949/1912] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:26 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:26.324634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.332110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:26.336397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531cefc-ae5b-4e3c-8e4e-8f085458e97d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.342760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.343531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.343993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.344450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.345375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.347233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.358597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 964/1913] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:26.362631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.379432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc39a6-a2ac-483f-9ebc-6529d49f9b98 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.384092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.384982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.385268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.385550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] PATH_INFO: `/v3/projects/99c90db9dec645999f1a48888ea66a82/users/65b601eb4e6f4e8fbf1bc5317690e6a5/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.407127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c90db9dec645999f1a48888ea66a82, user_id=65b601eb4e6f4e8fbf1bc5317690e6a5, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.411635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.435072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 950/1914] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:26 2022] PUT /identity/v3/projects/99c90db9dec645999f1a48888ea66a82/users/65b601eb4e6f4e8fbf1bc5317690e6a5/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:26.439926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.452558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68285777-e6c5-4f1d-a446-8db54befe847 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.516342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0a71e-e671-46fa-8a39-b3bd682fdacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.517022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0a71e-e671-46fa-8a39-b3bd682fdacb admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.517312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0a71e-e671-46fa-8a39-b3bd682fdacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.517597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0a71e-e671-46fa-8a39-b3bd682fdacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.518384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0a71e-e671-46fa-8a39-b3bd682fdacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.520002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0a71e-e671-46fa-8a39-b3bd682fdacb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.531122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 965/1915] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:26.535100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.542040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:26.547042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51febb6d-34ec-444e-b4dd-45c3da9a7ff8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.553994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.554894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.555186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.555468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] PATH_INFO: `/v3/projects/99c90db9dec645999f1a48888ea66a82/users/65b601eb4e6f4e8fbf1bc5317690e6a5/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.557425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c90db9dec645999f1a48888ea66a82, user_id=65b601eb4e6f4e8fbf1bc5317690e6a5, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.560085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.571650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 951/1916] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:26 2022] PUT /identity/v3/projects/99c90db9dec645999f1a48888ea66a82/users/65b601eb4e6f4e8fbf1bc5317690e6a5/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:26.581962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66df9-dbad-4eb8-8f77-e7774bfff000 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.582754 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66df9-dbad-4eb8-8f77-e7774bfff000 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.582754 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66df9-dbad-4eb8-8f77-e7774bfff000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.608568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f5b66df9-dbad-4eb8-8f77-e7774bfff000 None None] MFA Rules not processed for user `65b601eb4e6f4e8fbf1bc5317690e6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:26.609838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f5b66df9-dbad-4eb8-8f77-e7774bfff000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:26.683463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 966/1917] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:26.695439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.698201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:26.772588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a9535-9d81-4125-adce-c37768263e54 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.777677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee955da-b8cc-4298-969f-2b3f58f41c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.778689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee955da-b8cc-4298-969f-2b3f58f41c91 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.778689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee955da-b8cc-4298-969f-2b3f58f41c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.778923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee955da-b8cc-4298-969f-2b3f58f41c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.789778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee955da-b8cc-4298-969f-2b3f58f41c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.791240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee955da-b8cc-4298-969f-2b3f58f41c91 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.802241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 952/1918] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:26.866968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b66df9-dbad-4eb8-8f77-e7774bfff000 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:26.930432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b66df9-dbad-4eb8-8f77-e7774bfff000 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:26.940319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:26.941453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:26.941847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:26.942133 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] PATH_INFO: `/v3/users/030fe2c08b4643409bdabcaf04a90949` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:26.943625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] RBAC: Authorizing `identity:delete_user(user_id=030fe2c08b4643409bdabcaf04a90949)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:26.945592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:26.962320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:26.994849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030fe2c08b4643409bdabcaf04a90949'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.001550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030fe2c08b4643409bdabcaf04a90949'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.002239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030fe2c08b4643409bdabcaf04a90949'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.009326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030fe2c08b4643409bdabcaf04a90949'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.010026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030fe2c08b4643409bdabcaf04a90949'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.028325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 967/1919] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:26 2022] DELETE /identity/v3/users/030fe2c08b4643409bdabcaf04a90949 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:27.033965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:27.034290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:27.034630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:27.052645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:27.053860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:27.122524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 953/1920] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:27.132407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:27.133984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:27.192593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0ee3b-435c-412a-a711-587de5b858af admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:27.196321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:27.196963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:27.197249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:27.197528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:27.206894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:27.208313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:27.218342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 968/1921] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:27.599178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:27.603512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:27.623225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9d214-1614-4255-82eb-2110f9296065 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:27.629632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:27.631466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:27.631777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:27.632430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] PATH_INFO: `/v3/projects/74a976f9ddad4767ad91a96a78f98f1f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:27.634177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a976f9ddad4767ad91a96a78f98f1f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:27.636695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:27.745579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a976f9ddad4767ad91a96a78f98f1f', 'request_id': 'req-32b76b7f-e0ef-44df-8956-82e4000000a8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.762401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a976f9ddad4767ad91a96a78f98f1f', 'request_id': 'req-32b76b7f-e0ef-44df-8956-82e4000000a8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.794406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a976f9ddad4767ad91a96a78f98f1f', 'request_id': 'req-32b76b7f-e0ef-44df-8956-82e4000000a8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.819579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] The token cache is being invalidate because project 74a976f9ddad4767ad91a96a78f98f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:27.819951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.821396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:27.825809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 954/1922] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:27 2022] DELETE /identity/v3/projects/74a976f9ddad4767ad91a96a78f98f1f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:27.830251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:27.841181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa4219-53b2-43e9-81c6-2fca31efa7eb service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:27.916143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:27.917210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:27.917604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:27.918208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] PATH_INFO: `/v3/users/65b601eb4e6f4e8fbf1bc5317690e6a5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:27.919669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b601eb4e6f4e8fbf1bc5317690e6a5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:27.923822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:28.032611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:28.047115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b601eb4e6f4e8fbf1bc5317690e6a5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.060117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b601eb4e6f4e8fbf1bc5317690e6a5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.061363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b601eb4e6f4e8fbf1bc5317690e6a5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.075537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b601eb4e6f4e8fbf1bc5317690e6a5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.078051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f0bd74d-5c04-4b2f-bd43-8256d38a49b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b601eb4e6f4e8fbf1bc5317690e6a5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.131202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 969/1923] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:27 2022] DELETE /identity/v3/users/65b601eb4e6f4e8fbf1bc5317690e6a5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:28.736785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:28.738233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:28.752776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76b7f-e0ef-44df-8956-82e4000000a8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:28.770284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:28.829667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:28.830594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:28.830887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:28.831171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] PATH_INFO: `/v3/projects/99c90db9dec645999f1a48888ea66a82` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:28.832396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c90db9dec645999f1a48888ea66a82)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:28.834376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:28.879658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c90db9dec645999f1a48888ea66a82', 'request_id': 'req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.885610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c90db9dec645999f1a48888ea66a82', 'request_id': 'req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.892086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c90db9dec645999f1a48888ea66a82', 'request_id': 'req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.903599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] The token cache is being invalidate because project 99c90db9dec645999f1a48888ea66a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:28.903918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.904551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c5c1158c-4ca3-49c3-bfb2-68c55a0c499a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:28.906393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 955/1924] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:28 2022] DELETE /identity/v3/projects/99c90db9dec645999f1a48888ea66a82 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:28.911841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f235-afec-43ce-b990-079e351dbb38 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:28.912296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f235-afec-43ce-b990-079e351dbb38 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:28.912409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f235-afec-43ce-b990-079e351dbb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:28.929989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b338f235-afec-43ce-b990-079e351dbb38 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:28.931192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b338f235-afec-43ce-b990-079e351dbb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:28.993050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 970/1925] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:29.002665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3afb-d37c-462e-b264-2aec7c409303 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.002967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3afb-d37c-462e-b264-2aec7c409303 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.003256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3afb-d37c-462e-b264-2aec7c409303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.024866 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1cec3afb-d37c-462e-b264-2aec7c409303 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:29.026197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1cec3afb-d37c-462e-b264-2aec7c409303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:29.034947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 956/1926] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:29.038996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f235-afec-43ce-b990-079e351dbb38 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.049493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f235-afec-43ce-b990-079e351dbb38 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.054510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.055273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.055639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.055983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.056811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:29.057191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.058896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.074305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 971/1927] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:57:29.078692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec3afb-d37c-462e-b264-2aec7c409303 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.088022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec3afb-d37c-462e-b264-2aec7c409303 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.092808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.093474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.093790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.094085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.095321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.097226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.124632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 957/1928] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:29 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:29.128616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.141008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5f51f-aec3-4dfa-a3c2-3f71d2bbd350 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.202389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.203070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.203361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.203672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.204382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.206335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.230698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 972/1929] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:29 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:29.235658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.248298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97feb-d964-4841-8709-f95440e58855 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.253075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.253765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.254069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.254356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.255087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.256694 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.271015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 958/1930] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:29.274533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.285717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754da27-4a2e-43fd-91f0-909e4830a343 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.290406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f0477-e148-419c-8fcd-d4152f8dba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.291068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f0477-e148-419c-8fcd-d4152f8dba18 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.291363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f0477-e148-419c-8fcd-d4152f8dba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.291646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f0477-e148-419c-8fcd-d4152f8dba18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.292583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f0477-e148-419c-8fcd-d4152f8dba18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.294017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f0477-e148-419c-8fcd-d4152f8dba18 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.304600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 973/1931] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:29.308810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.318794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563a8c0-0f1f-40df-80eb-082bc007f0ba admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.323773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.324810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.325131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.325413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] PATH_INFO: `/v3/projects/5de95e8a96b145b08fd10aebf11e502b/users/6ae66f58781a42a693fa35465dac730f/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.340363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de95e8a96b145b08fd10aebf11e502b, user_id=6ae66f58781a42a693fa35465dac730f, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.343689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.357342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 959/1932] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:29 2022] PUT /identity/v3/projects/5de95e8a96b145b08fd10aebf11e502b/users/6ae66f58781a42a693fa35465dac730f/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:29.367976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f8560-9061-498e-8546-9547c6e512ec None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.368270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f8560-9061-498e-8546-9547c6e512ec None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.368547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f8560-9061-498e-8546-9547c6e512ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.403642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8f3f8560-9061-498e-8546-9547c6e512ec None None] MFA Rules not processed for user `6ae66f58781a42a693fa35465dac730f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:29.404951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8f3f8560-9061-498e-8546-9547c6e512ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:29.414939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:29.477940 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 974/1933] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:29.482344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.553286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:29.572666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3eb0-795c-40ec-8560-e60cf12bceeb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.577886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.579271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.579575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.579858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.581904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.587243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.621371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 960/1934] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:29 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:29.625823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f8560-9061-498e-8546-9547c6e512ec None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.640048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f8560-9061-498e-8546-9547c6e512ec None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.708764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.709438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.709726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.710041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.710747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.712653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.739953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 975/1935] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:29 2022] POST /identity/v3/users => generated 311 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:29.747431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.759166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8374-ff24-4053-a3e5-b1c19d41f1ea admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.764189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.764850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.765139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.765416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.766688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.768314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.779909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 961/1936] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:29.784989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.795774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b4cc6-8627-451d-bb88-e684c7be1350 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.800996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.801846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.802147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.802453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] PATH_INFO: `/v3/projects/4b1d737749cb4dd793e111ee5bc73b7e/users/a5043c20928c4746a6723fbf7dc9b346/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.819778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1d737749cb4dd793e111ee5bc73b7e, user_id=a5043c20928c4746a6723fbf7dc9b346, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.822508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.838605 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 976/1937] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:29 2022] PUT /identity/v3/projects/4b1d737749cb4dd793e111ee5bc73b7e/users/a5043c20928c4746a6723fbf7dc9b346/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:29.842693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.854984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50ae8-d43c-44c1-a2ee-876f4d8ae773 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.955212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3933c2-1a9d-4c28-ab76-c3e55a6d9f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.956489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3933c2-1a9d-4c28-ab76-c3e55a6d9f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.956898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3933c2-1a9d-4c28-ab76-c3e55a6d9f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:29.957286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3933c2-1a9d-4c28-ab76-c3e55a6d9f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:29.959107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3933c2-1a9d-4c28-ab76-c3e55a6d9f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:29.962616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3933c2-1a9d-4c28-ab76-c3e55a6d9f25 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:29.979336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 962/1938] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:29.980803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:29.992512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f12c1-0e66-4072-b359-fec09e770e3f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:29.997884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:29.999190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:29.999686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:30.000182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] PATH_INFO: `/v3/projects/4b1d737749cb4dd793e111ee5bc73b7e/users/a5043c20928c4746a6723fbf7dc9b346/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:30.004422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1d737749cb4dd793e111ee5bc73b7e, user_id=a5043c20928c4746a6723fbf7dc9b346, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:30.007796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:30.021131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 977/1939] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:29 2022] PUT /identity/v3/projects/4b1d737749cb4dd793e111ee5bc73b7e/users/a5043c20928c4746a6723fbf7dc9b346/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:30.031760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b4e2-fe59-4e27-ae4d-2666e8b4f31c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:30.032461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b4e2-fe59-4e27-ae4d-2666e8b4f31c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:30.032753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b4e2-fe59-4e27-ae4d-2666e8b4f31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:30.064228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7e29b4e2-fe59-4e27-ae4d-2666e8b4f31c None None] MFA Rules not processed for user `a5043c20928c4746a6723fbf7dc9b346`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:30.065695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7e29b4e2-fe59-4e27-ae4d-2666e8b4f31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:30.177695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 963/1940] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:30.185962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:30.187814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:30.298347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251b3b3-085b-42c1-9c1a-b9dac5794fb8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:30.310451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:30.311138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:30.311707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:30.311707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:30.335944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:30.337459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:30.359425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 978/1941] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:30.567394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29b4e2-fe59-4e27-ae4d-2666e8b4f31c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:30.577094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29b4e2-fe59-4e27-ae4d-2666e8b4f31c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:30.580869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c4e37-40bc-40db-bba5-1134aa5be539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:30.581562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4e37-40bc-40db-bba5-1134aa5be539 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:30.581890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4e37-40bc-40db-bba5-1134aa5be539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:30.582169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4e37-40bc-40db-bba5-1134aa5be539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:30.622789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:30.647195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c4e37-40bc-40db-bba5-1134aa5be539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:30.648996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c4e37-40bc-40db-bba5-1134aa5be539 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:30.661232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 964/1942] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:31.054063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:31.056223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:31.084319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:31.153591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a5e9-90cf-4e55-a79f-81c0cbdbdc74 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:31.159942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:31.160995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:31.161317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:31.161684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] PATH_INFO: `/v3/users/33141207ed054b86b297518452b9ff78` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:31.162960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33141207ed054b86b297518452b9ff78)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:31.165142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:31.214029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33141207ed054b86b297518452b9ff78'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.223627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33141207ed054b86b297518452b9ff78'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.224434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33141207ed054b86b297518452b9ff78'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.232385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33141207ed054b86b297518452b9ff78'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.233107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33141207ed054b86b297518452b9ff78'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.252178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 979/1943] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:31 2022] DELETE /identity/v3/users/33141207ed054b86b297518452b9ff78 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:31.256596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:31.257041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:31.257168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:31.277002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:31.278270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:31.338443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 965/1944] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:31.347916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:31.349285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:31.410747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e465e-0d1c-4d55-b863-2574a4de2bd3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:31.414600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbac46-9c4d-48c0-9b1d-b22d4c7306bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:31.415250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbac46-9c4d-48c0-9b1d-b22d4c7306bc service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:31.415547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbac46-9c4d-48c0-9b1d-b22d4c7306bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:31.415822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbac46-9c4d-48c0-9b1d-b22d4c7306bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:31.425352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbac46-9c4d-48c0-9b1d-b22d4c7306bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:31.426895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbac46-9c4d-48c0-9b1d-b22d4c7306bc service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:31.436859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 980/1945] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:31.716362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:31.717861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:31.730227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f8405-d100-45cb-9ee8-302e2285b55a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:31.735450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:31.736369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:31.736651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:31.736926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] PATH_INFO: `/v3/projects/47107add410244a2a354846d1ca475dc` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:31.738143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47107add410244a2a354846d1ca475dc)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:31.740048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:31.788443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47107add410244a2a354846d1ca475dc', 'request_id': 'req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.794687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47107add410244a2a354846d1ca475dc', 'request_id': 'req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.800880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47107add410244a2a354846d1ca475dc', 'request_id': 'req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.814625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] The token cache is being invalidate because project 47107add410244a2a354846d1ca475dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:31.814921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.815857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-08cc8057-9d51-4e83-ba6e-b9a55b6fac03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:31.817790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 966/1946] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:31 2022] DELETE /identity/v3/projects/47107add410244a2a354846d1ca475dc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:31.822422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e582b-ce38-41a0-a9c3-c27bc81f92d0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:31.822911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e582b-ce38-41a0-a9c3-c27bc81f92d0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:31.823374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e582b-ce38-41a0-a9c3-c27bc81f92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:31.842844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d05e582b-ce38-41a0-a9c3-c27bc81f92d0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:31.844116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d05e582b-ce38-41a0-a9c3-c27bc81f92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:31.872108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:31.910674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 981/1947] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:31.919646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9e1c8-0474-4dc8-842d-4379514b1ee0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:31.919950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9e1c8-0474-4dc8-842d-4379514b1ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:31.920236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9e1c8-0474-4dc8-842d-4379514b1ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:31.940171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a6e9e1c8-0474-4dc8-842d-4379514b1ee0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:31.941374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a6e9e1c8-0474-4dc8-842d-4379514b1ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:31.949581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 967/1948] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:31.954401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e582b-ce38-41a0-a9c3-c27bc81f92d0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:31.965026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e582b-ce38-41a0-a9c3-c27bc81f92d0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:31.970271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:31.970946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:31.971224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:31.971508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:31.972240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:31.972553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:31.974248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:31.989861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 982/1949] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:57:32.004655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9e1c8-0474-4dc8-842d-4379514b1ee0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:32.032424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9e1c8-0474-4dc8-842d-4379514b1ee0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:32.037362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:32.038698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:32.038991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:32.039292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:32.040008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:32.041950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:32.073514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 968/1950] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:32 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:32.078093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:32.097578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50834740-675e-40fc-b373-5d1fe49e4775 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:32.193537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:32.194510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:32.194901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:32.195265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:32.196092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:32.198261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:32.232406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 983/1951] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:32 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:32.236613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:32.252390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641ee4-225f-495c-8e8a-6364d648364d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:32.258345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:32.260427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:32.260981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:32.261567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:32.262604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:32.264486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:32.283795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 969/1952] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:32.288362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:32.304247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c355afb-8372-4202-9cce-731096d70e51 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:32.311803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b3b5b-15de-470f-b228-b8d40710a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:32.312668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b3b5b-15de-470f-b228-b8d40710a148 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:32.313610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b3b5b-15de-470f-b228-b8d40710a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:32.313960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b3b5b-15de-470f-b228-b8d40710a148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:32.314775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b3b5b-15de-470f-b228-b8d40710a148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:32.316468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b3b5b-15de-470f-b228-b8d40710a148 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:32.339561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 984/1953] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:32.343698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:32.361002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd880ba-12ef-4ac8-a67a-fd78c6f1d4a7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:32.367538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:32.368614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:32.369035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:32.369877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] PATH_INFO: `/v3/projects/5307889243b44f40a6c897680dd1ec93/users/e58d378de3874c648a511c45015f5f16/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:32.397634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5307889243b44f40a6c897680dd1ec93, user_id=e58d378de3874c648a511c45015f5f16, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:32.403747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:32.424950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:32.438234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 970/1954] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:32 2022] PUT /identity/v3/projects/5307889243b44f40a6c897680dd1ec93/users/e58d378de3874c648a511c45015f5f16/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:32.444004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:32.444352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:32.444618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:32.479601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] MFA Rules not processed for user `e58d378de3874c648a511c45015f5f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:32.480886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:32.553468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 985/1955] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:32.561271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:32.562971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:32.625924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770782a-95f9-4a53-90ad-bc495ca70f53 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:32.632249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af231ab5-293d-45e2-accf-4ecd00b8af26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:32.632997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af231ab5-293d-45e2-accf-4ecd00b8af26 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:32.633349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af231ab5-293d-45e2-accf-4ecd00b8af26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:32.633697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af231ab5-293d-45e2-accf-4ecd00b8af26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:32.643157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af231ab5-293d-45e2-accf-4ecd00b8af26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:32.644655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af231ab5-293d-45e2-accf-4ecd00b8af26 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:32.654835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 971/1956] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:42.547624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:42.649559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=27 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:48.504147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:48.506028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:48.584212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fa86-d651-4a9b-b511-55212e955428 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:48.590586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:48.591472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:48.591759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:48.594103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] PATH_INFO: `/v3/users/e78c43e4248c4db681b29c1f630dfd72` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:48.595384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78c43e4248c4db681b29c1f630dfd72)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:48.598265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:48.709452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78c43e4248c4db681b29c1f630dfd72'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:48.721774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78c43e4248c4db681b29c1f630dfd72'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:48.723147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78c43e4248c4db681b29c1f630dfd72'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:48.737158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78c43e4248c4db681b29c1f630dfd72'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:48.738308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78c43e4248c4db681b29c1f630dfd72'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:48.761870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 986/1957] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:48 2022] DELETE /identity/v3/users/e78c43e4248c4db681b29c1f630dfd72 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:48.766931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:48.767440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:48.767534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:48.805837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:48.807212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:48.809301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:48.814379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:48.903949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 972/1958] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:48.924399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:48.928098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:48.939191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217edf-e904-4988-8315-95140a697b6c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:48.947273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:48.958268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:48.958268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:48.958268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] PATH_INFO: `/v3/users/6ae66f58781a42a693fa35465dac730f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:48.958268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae66f58781a42a693fa35465dac730f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:48.958268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:49.000311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:49.042211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae66f58781a42a693fa35465dac730f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.066392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae66f58781a42a693fa35465dac730f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.067840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae66f58781a42a693fa35465dac730f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.098186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae66f58781a42a693fa35465dac730f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.100257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d562a4c6-f5fb-4bf1-a60c-13867f84ca5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae66f58781a42a693fa35465dac730f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.104471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eeb19-147e-4e98-819b-a7415cdc8153 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:49.117356 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:49.118456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:49.119582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:49.120983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:49.127251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:49.146420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 987/1959] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:48 2022] DELETE /identity/v3/users/6ae66f58781a42a693fa35465dac730f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:49.150507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bada3-fead-49a4-816c-23061f96d11c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:49.150767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:49.151250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bada3-fead-49a4-816c-23061f96d11c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:49.151948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bada3-fead-49a4-816c-23061f96d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:49.152602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:49.167265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 973/1960] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:49.173921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-351bada3-fead-49a4-816c-23061f96d11c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:49.175398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-351bada3-fead-49a4-816c-23061f96d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:49.247761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 988/1961] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:49.261664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:49.263720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:49.281522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764140a-d22b-43da-aba8-b0a7c07d807a service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:49.342792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:49.343629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:49.344990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:49.344990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:49.355840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:49.357384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:49.371570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 974/1962] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:49.536055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bada3-fead-49a4-816c-23061f96d11c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:49.538422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-351bada3-fead-49a4-816c-23061f96d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:49.566942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bada3-fead-49a4-816c-23061f96d11c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:49.583194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:49.584428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:49.584790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:49.585185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] PATH_INFO: `/v3/projects/59c8ce3af6ab4503b0ec5a345a8618bc` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:49.586947 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c8ce3af6ab4503b0ec5a345a8618bc)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:49.591296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:49.659021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c8ce3af6ab4503b0ec5a345a8618bc', 'request_id': 'req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.668241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c8ce3af6ab4503b0ec5a345a8618bc', 'request_id': 'req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.680297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c8ce3af6ab4503b0ec5a345a8618bc', 'request_id': 'req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.693869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] The token cache is being invalidate because project 59c8ce3af6ab4503b0ec5a345a8618bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:49.694162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.694843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.696799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 989/1963] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:49 2022] DELETE /identity/v3/projects/59c8ce3af6ab4503b0ec5a345a8618bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:49.700596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:49.706803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:49.708635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:49.711072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af4ce-6d97-4366-92f4-888d102d19ad service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:49.740424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:49.770578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:49.786738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:49.787626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:49.787917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:49.788191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] PATH_INFO: `/v3/users/c0242a8af6cd4b7386521bfc5197b953` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:49.789273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdd73a-7b78-4241-8787-83cbb8ec90d0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:49.789464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0242a8af6cd4b7386521bfc5197b953)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:49.791437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:49.795236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:49.796276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:49.796607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:49.796837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] PATH_INFO: `/v3/projects/5de95e8a96b145b08fd10aebf11e502b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:49.798612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de95e8a96b145b08fd10aebf11e502b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:49.800558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:49.846104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0242a8af6cd4b7386521bfc5197b953'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.856179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0242a8af6cd4b7386521bfc5197b953'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.856964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0242a8af6cd4b7386521bfc5197b953'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.866667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de95e8a96b145b08fd10aebf11e502b', 'request_id': 'req-9360d86b-b393-47d7-964c-7ba3b9ba7138'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.870489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0242a8af6cd4b7386521bfc5197b953'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.871369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0242a8af6cd4b7386521bfc5197b953'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.873199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de95e8a96b145b08fd10aebf11e502b', 'request_id': 'req-9360d86b-b393-47d7-964c-7ba3b9ba7138'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.881403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de95e8a96b145b08fd10aebf11e502b', 'request_id': 'req-9360d86b-b393-47d7-964c-7ba3b9ba7138'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.892813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 975/1964] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:49 2022] DELETE /identity/v3/users/c0242a8af6cd4b7386521bfc5197b953 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:49.894432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] The token cache is being invalidate because project 5de95e8a96b145b08fd10aebf11e502b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:49.894729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.895516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:49.902304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 990/1965] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:49 2022] DELETE /identity/v3/projects/5de95e8a96b145b08fd10aebf11e502b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:49.903732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:49.905178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:49.990593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85378b-f407-4e0b-8787-b3f8b6481784 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:49.997205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:49.998598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:49.998957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:49.999433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] PATH_INFO: `/v3/users/a5043c20928c4746a6723fbf7dc9b346` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.001002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5043c20928c4746a6723fbf7dc9b346)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.003250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.065321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5043c20928c4746a6723fbf7dc9b346'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.074715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5043c20928c4746a6723fbf7dc9b346'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.075637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5043c20928c4746a6723fbf7dc9b346'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.084857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5043c20928c4746a6723fbf7dc9b346'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.086381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-186922c3-6048-48ea-8c3a-f7d13a824d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5043c20928c4746a6723fbf7dc9b346'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.092537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:50.130365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 976/1966] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:49 2022] DELETE /identity/v3/users/a5043c20928c4746a6723fbf7dc9b346 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:50.294675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.296374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:50.408684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d86b-b393-47d7-964c-7ba3b9ba7138 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.482706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.483582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.483872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.484155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] PATH_INFO: `/v3/projects/87223c3677384735b2d22e24fc27964b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.485927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87223c3677384735b2d22e24fc27964b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.487874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.489874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:50.541199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87223c3677384735b2d22e24fc27964b', 'request_id': 'req-cb6d6c45-4c44-4068-be10-a2fee65ec127'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.547213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87223c3677384735b2d22e24fc27964b', 'request_id': 'req-cb6d6c45-4c44-4068-be10-a2fee65ec127'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.555615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87223c3677384735b2d22e24fc27964b', 'request_id': 'req-cb6d6c45-4c44-4068-be10-a2fee65ec127'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.568070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] The token cache is being invalidate because project 87223c3677384735b2d22e24fc27964b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:50.568471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.569126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.570753 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 991/1967] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:50 2022] DELETE /identity/v3/projects/87223c3677384735b2d22e24fc27964b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:50.576047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.576778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373e38-518a-4f4e-a20e-a6df2f2917b4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.577145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373e38-518a-4f4e-a20e-a6df2f2917b4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.577503 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373e38-518a-4f4e-a20e-a6df2f2917b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.578385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:50.597355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9a373e38-518a-4f4e-a20e-a6df2f2917b4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:50.598775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a373e38-518a-4f4e-a20e-a6df2f2917b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:50.652526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6c45-4c44-4068-be10-a2fee65ec127 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.657961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.658829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.659112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.659392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] PATH_INFO: `/v3/projects/4b1d737749cb4dd793e111ee5bc73b7e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.660555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1d737749cb4dd793e111ee5bc73b7e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.662612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.663291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 977/1968] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:50.670832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e9024-3f91-491b-bb9d-064aa79647c6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.671134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e9024-3f91-491b-bb9d-064aa79647c6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.671440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e9024-3f91-491b-bb9d-064aa79647c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.689626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2e8e9024-3f91-491b-bb9d-064aa79647c6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:50.690864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2e8e9024-3f91-491b-bb9d-064aa79647c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:50.698917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 978/1969] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:50.703133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e9024-3f91-491b-bb9d-064aa79647c6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.709680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1d737749cb4dd793e111ee5bc73b7e', 'request_id': 'req-6b9eccce-2fd5-4697-bff1-751896093948'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.712438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e9024-3f91-491b-bb9d-064aa79647c6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.715257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1d737749cb4dd793e111ee5bc73b7e', 'request_id': 'req-6b9eccce-2fd5-4697-bff1-751896093948'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.723907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1d737749cb4dd793e111ee5bc73b7e', 'request_id': 'req-6b9eccce-2fd5-4697-bff1-751896093948'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.735664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] The token cache is being invalidate because project 4b1d737749cb4dd793e111ee5bc73b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:50.735945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.736613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b9eccce-2fd5-4697-bff1-751896093948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:50.738578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 992/1970] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:50 2022] DELETE /identity/v3/projects/4b1d737749cb4dd793e111ee5bc73b7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:50.743229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3fbba-8ee6-4f6e-a963-01b2b35c6282 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.743518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3fbba-8ee6-4f6e-a963-01b2b35c6282 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.743800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3fbba-8ee6-4f6e-a963-01b2b35c6282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.761441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2ea3fbba-8ee6-4f6e-a963-01b2b35c6282 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:50.762661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2ea3fbba-8ee6-4f6e-a963-01b2b35c6282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:50.771512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.772189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.772476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.772758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.773479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:50.773970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.775593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.776342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:50.788090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 979/1971] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:57:50.792347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.794036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:50.806054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c413-d9db-477c-a37d-57e4ce00df4d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.810752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.811396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.811686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.811978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.812663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.815221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.824654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 993/1972] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:50.834238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c3f5-b44f-4732-8a07-394d90b234e5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.834797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c3f5-b44f-4732-8a07-394d90b234e5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.835238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c3f5-b44f-4732-8a07-394d90b234e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.849510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 980/1973] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:50 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:50.850555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.854626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-30d4c3f5-b44f-4732-8a07-394d90b234e5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:50.855817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-30d4c3f5-b44f-4732-8a07-394d90b234e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:50.908309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:50.918580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 994/1974] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:50.921539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0baae-8b9f-4058-9690-5bbe3d104071 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.922922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4c3f5-b44f-4732-8a07-394d90b234e5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.926859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.927535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.927839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.928118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.928804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.930771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.932051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4c3f5-b44f-4732-8a07-394d90b234e5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.936685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.937399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.937620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.937930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.939221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:50.939533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.941126 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.951888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 981/1975] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:50 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:50.958575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 995/1976] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:57:50.958726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.959582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.966020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5a515-ac7c-4837-b90d-a7094101bece admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.969018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515331b9-b2c2-4103-96e7-eb06b75e1358 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:50.971877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.972550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.972857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.973140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.973892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.974238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:50.974872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:50.975159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:50.975439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:50.975529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.976276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:50.978202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:50.985558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 982/1977] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:50.989397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:50.999225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ed425-c021-4437-abe3-73e72c57eec2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.004567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.005222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.005344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 996/1978] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:50 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:51.008651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.008957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.009364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.009707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.011366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.025469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 983/1979] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:51.026443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.036240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b91b16-e8d8-48c8-a75f-e043d033db32 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.072512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d89a2-40b7-4b7a-828b-b962652bebf5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.077214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.077916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.078208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.078490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.079243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.081222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.092712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e57ec-ce08-4529-9536-cebd9db30d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.093768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e57ec-ce08-4529-9536-cebd9db30d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.094279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e57ec-ce08-4529-9536-cebd9db30d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.095118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e57ec-ce08-4529-9536-cebd9db30d9b admin admin] PATH_INFO: `/v3/projects/98cbd0d4c732471b9c8ab6bf92f6f05c/users/5a91bcb445094e7cb4cd8fd66ea27aeb/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.101650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 997/1980] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:51 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:57:51.105640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.111919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e57ec-ce08-4529-9536-cebd9db30d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cbd0d4c732471b9c8ab6bf92f6f05c, user_id=5a91bcb445094e7cb4cd8fd66ea27aeb, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.114639 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e57ec-ce08-4529-9536-cebd9db30d9b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.116004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdf0c1-8d36-4478-bdcf-7f8b909af57a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.122254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.123051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.123713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.124203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.125485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.127296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.129953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 984/1981] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:51 2022] PUT /identity/v3/projects/98cbd0d4c732471b9c8ab6bf92f6f05c/users/5a91bcb445094e7cb4cd8fd66ea27aeb/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:51.142125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 998/1982] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:51.142255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd28a3-4f66-405e-8846-eec02b7a0f0f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.142255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd28a3-4f66-405e-8846-eec02b7a0f0f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.142255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd28a3-4f66-405e-8846-eec02b7a0f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.143458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.150282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:51.154564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5bdb8-2ea5-4676-92d6-85d4c4512c73 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.178128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5cdd28a3-4f66-405e-8846-eec02b7a0f0f None None] MFA Rules not processed for user `5a91bcb445094e7cb4cd8fd66ea27aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:51.178128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5cdd28a3-4f66-405e-8846-eec02b7a0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:51.226672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.227351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.227639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.227922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.228752 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.230461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.240912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 999/1983] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:51.244893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.251138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 985/1984] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:51.254299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209e28-d317-4631-9d5a-3f56a3d57ce3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.256627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd28a3-4f66-405e-8846-eec02b7a0f0f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.260166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c014e3-76a3-4490-b98d-dee0ae53813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.261077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c014e3-76a3-4490-b98d-dee0ae53813b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.261375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c014e3-76a3-4490-b98d-dee0ae53813b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.261601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c014e3-76a3-4490-b98d-dee0ae53813b admin admin] PATH_INFO: `/v3/projects/a827f96798444133b97aa60c4b8ccd54/users/3ee39c83cf9c4d09ac74b27d0fd79676/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.269432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd28a3-4f66-405e-8846-eec02b7a0f0f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.275289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.276280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.276854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.277144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.277878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.278573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c014e3-76a3-4490-b98d-dee0ae53813b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a827f96798444133b97aa60c4b8ccd54, user_id=3ee39c83cf9c4d09ac74b27d0fd79676, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.279807 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.281579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c014e3-76a3-4490-b98d-dee0ae53813b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.295655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1000/1985] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:51 2022] PUT /identity/v3/projects/a827f96798444133b97aa60c4b8ccd54/users/3ee39c83cf9c4d09ac74b27d0fd79676/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:51.307419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.307855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.308295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.321024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 986/1986] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:51 2022] POST /identity/v3/projects => generated 353 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:51.322149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.333045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:51.340415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] MFA Rules not processed for user `3ee39c83cf9c4d09ac74b27d0fd79676`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:51.341990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:51.397959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e273-b02c-4bbb-a1d6-8b6f8296f592 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.402945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.403770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.404068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.404345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.405148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.407412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.418858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1001/1987] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:51.431516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.433077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:51.440684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 987/1988] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:51 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:51.442090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.451848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8a68-58e2-4823-9219-5f020d5901d8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.457252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.457943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.458231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.458521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.459237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.460863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.471368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 988/1989] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:51.475366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.484612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa92a0-2a52-4225-b9ab-b8fba8d0334a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.489198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.490094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.490387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.490666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] PATH_INFO: `/v3/projects/99c97ced16054be9922ee61f83ace995/users/bda94b8fefcb41efab3a6d9e609cfc9a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.492772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0df9-2523-4295-9c76-487ad453df2f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.496536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.497179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.497468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.497777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.505249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c97ced16054be9922ee61f83ace995, user_id=bda94b8fefcb41efab3a6d9e609cfc9a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.507988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.510683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.512127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.524621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1002/1990] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:57:51.527414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 989/1991] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:51 2022] PUT /identity/v3/projects/99c97ced16054be9922ee61f83ace995/users/bda94b8fefcb41efab3a6d9e609cfc9a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:51.531566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.543735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5625abb-3148-4238-8ac1-9300b73ed7e3 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.548780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:51.607892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcee255-fb55-40a8-b3a5-049f5f5b78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.608629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcee255-fb55-40a8-b3a5-049f5f5b78ed admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.608847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcee255-fb55-40a8-b3a5-049f5f5b78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.609131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcee255-fb55-40a8-b3a5-049f5f5b78ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.610104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcee255-fb55-40a8-b3a5-049f5f5b78ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.611873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcee255-fb55-40a8-b3a5-049f5f5b78ed admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.622260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1003/1992] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:51.626947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.638776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa465-5160-4821-b8dc-cb6a40241e50 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.644258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.645240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.645609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.645991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] PATH_INFO: `/v3/projects/99c97ced16054be9922ee61f83ace995/users/bda94b8fefcb41efab3a6d9e609cfc9a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.648092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c97ced16054be9922ee61f83ace995, user_id=bda94b8fefcb41efab3a6d9e609cfc9a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.651014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.663436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 990/1993] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:51 2022] PUT /identity/v3/projects/99c97ced16054be9922ee61f83ace995/users/bda94b8fefcb41efab3a6d9e609cfc9a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:51.674719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392a2a8-80ff-4a9d-922d-a573e36a1397 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.675020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392a2a8-80ff-4a9d-922d-a573e36a1397 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.675310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392a2a8-80ff-4a9d-922d-a573e36a1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.706384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9392a2a8-80ff-4a9d-922d-a573e36a1397 None None] MFA Rules not processed for user `bda94b8fefcb41efab3a6d9e609cfc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:51.707604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9392a2a8-80ff-4a9d-922d-a573e36a1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:51.786075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1004/1994] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:51.794812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.797370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:51.866009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945434f-5687-4e91-947c-ce66689bca43 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.870217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4f8bc-7af4-4ead-ac2c-dfe2478cd22f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.870834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4f8bc-7af4-4ead-ac2c-dfe2478cd22f service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.871118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4f8bc-7af4-4ead-ac2c-dfe2478cd22f service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.871402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4f8bc-7af4-4ead-ac2c-dfe2478cd22f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:51.881526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4f8bc-7af4-4ead-ac2c-dfe2478cd22f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:51.883024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4f8bc-7af4-4ead-ac2c-dfe2478cd22f service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:51.893544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 991/1995] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:51 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:51.964830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392a2a8-80ff-4a9d-922d-a573e36a1397 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:51.974214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392a2a8-80ff-4a9d-922d-a573e36a1397 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:51.977807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4833e-9b28-431b-9ef5-f5c520409540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:51.978442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4833e-9b28-431b-9ef5-f5c520409540 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:51.978820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4833e-9b28-431b-9ef5-f5c520409540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:51.979101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4833e-9b28-431b-9ef5-f5c520409540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:52.038124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4833e-9b28-431b-9ef5-f5c520409540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:52.039849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4833e-9b28-431b-9ef5-f5c520409540 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:52.049290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1005/1996] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:51 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:55.771611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dedb08-a7da-46de-8001-80b1aa31c96a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:55.772607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dedb08-a7da-46de-8001-80b1aa31c96a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:55.772900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dedb08-a7da-46de-8001-80b1aa31c96a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:55.774380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 992/1997] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 09:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:57:55.783012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:55.784074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:55.784558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:55.804809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:55.806038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:55.832888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:55.883858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1006/1998] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 09:57:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:55.908100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dedb08-a7da-46de-8001-80b1aa31c96a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:55.909821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e7dedb08-a7da-46de-8001-80b1aa31c96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:55.934429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dedb08-a7da-46de-8001-80b1aa31c96a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:55.939639 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:55.940283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:55.940566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:55.940843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:55.950240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:55.951820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:55.963689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 993/1999] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:56.533289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:56.535407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:56.622285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f1139-7dca-4954-a744-67e519232a24 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:56.626901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:56.627765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:56.628050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:56.628361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] PATH_INFO: `/v3/users/cca4ab9101dc4e76ac101d83ed0d9ab9` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:56.629547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca4ab9101dc4e76ac101d83ed0d9ab9)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:56.631518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:56.709347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca4ab9101dc4e76ac101d83ed0d9ab9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.723346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca4ab9101dc4e76ac101d83ed0d9ab9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.723346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca4ab9101dc4e76ac101d83ed0d9ab9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.735997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca4ab9101dc4e76ac101d83ed0d9ab9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.737008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58105e59-83a3-4b5f-b1c7-846a5cb56aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca4ab9101dc4e76ac101d83ed0d9ab9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.747698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:56.761527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8dab-9706-46b6-b9e1-df3e8654cc2f service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:56.767238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:56.767369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1007/2000] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:56 2022] DELETE /identity/v3/users/cca4ab9101dc4e76ac101d83ed0d9ab9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:56.768259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:56.768641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:56.769021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] PATH_INFO: `/v3/users/3ee39c83cf9c4d09ac74b27d0fd79676` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:56.770329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee39c83cf9c4d09ac74b27d0fd79676)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:56.772323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:56.815361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:56.832060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee39c83cf9c4d09ac74b27d0fd79676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.841770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee39c83cf9c4d09ac74b27d0fd79676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.842877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee39c83cf9c4d09ac74b27d0fd79676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.853857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee39c83cf9c4d09ac74b27d0fd79676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.855297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee39c83cf9c4d09ac74b27d0fd79676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:56.882132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 994/2001] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:56 2022] DELETE /identity/v3/users/3ee39c83cf9c4d09ac74b27d0fd79676 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:56.884635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:56.885088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:56.885208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:56.904263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:56.905595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:56.954869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:56.977307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1008/2002] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:56.993615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:56.995100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:57.058133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384507a-9268-4be4-929b-03303fec802f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:57.061906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f4db-df43-4f50-802a-492e30f2d516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:57.062590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f4db-df43-4f50-802a-492e30f2d516 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:57.062862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f4db-df43-4f50-802a-492e30f2d516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:57.063178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f4db-df43-4f50-802a-492e30f2d516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:57.073107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f4db-df43-4f50-802a-492e30f2d516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:57.074628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f4db-df43-4f50-802a-492e30f2d516 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:57.084955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 995/2003] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:57.400747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:57.402304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:57.417460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb96c-a871-41ef-87b4-fcff7bf4a74c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:57.424516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:57.425403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:57.425696 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:57.426368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] PATH_INFO: `/v3/projects/a827f96798444133b97aa60c4b8ccd54` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:57.428950 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a827f96798444133b97aa60c4b8ccd54)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:57.431096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:57.487540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a827f96798444133b97aa60c4b8ccd54', 'request_id': 'req-58e639d2-4950-4106-91b6-ab5e6c5f333d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.493734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a827f96798444133b97aa60c4b8ccd54', 'request_id': 'req-58e639d2-4950-4106-91b6-ab5e6c5f333d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.504293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a827f96798444133b97aa60c4b8ccd54', 'request_id': 'req-58e639d2-4950-4106-91b6-ab5e6c5f333d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.516710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] The token cache is being invalidate because project a827f96798444133b97aa60c4b8ccd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:57.517018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.517679 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.520050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1009/2004] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:57 2022] DELETE /identity/v3/projects/a827f96798444133b97aa60c4b8ccd54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:57.529333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218718e-0bc3-4660-9f4c-18b60e9cc74c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:57.533611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218718e-0bc3-4660-9f4c-18b60e9cc74c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:57.533994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218718e-0bc3-4660-9f4c-18b60e9cc74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:57.559022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f218718e-0bc3-4660-9f4c-18b60e9cc74c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:57.560392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f218718e-0bc3-4660-9f4c-18b60e9cc74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:57.563820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:57.565142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:57.700380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 996/2005] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:57.708641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97292b80-b57d-4d22-8c63-8a4b3c90798e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:57.708910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97292b80-b57d-4d22-8c63-8a4b3c90798e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:57.709200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97292b80-b57d-4d22-8c63-8a4b3c90798e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:57.719937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e639d2-4950-4106-91b6-ab5e6c5f333d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:57.728351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:57.729346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:57.729644 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:57.729959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] PATH_INFO: `/v3/projects/a27b10ab52bf40a0bcf253f21f9e344e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:57.731175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27b10ab52bf40a0bcf253f21f9e344e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:57.733608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:57.741698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-97292b80-b57d-4d22-8c63-8a4b3c90798e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:57.743517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-97292b80-b57d-4d22-8c63-8a4b3c90798e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:57.757077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 997/2006] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:57:57.769991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97292b80-b57d-4d22-8c63-8a4b3c90798e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:57.780653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97292b80-b57d-4d22-8c63-8a4b3c90798e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:57.787828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:57.788609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:57.789073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:57.789856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:57.790750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:57.791251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:57.794969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:57.815710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 998/2007] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:57:57.817029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:57.827424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27b10ab52bf40a0bcf253f21f9e344e', 'request_id': 'req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.830660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390dab0-b02b-48c3-b15f-4fbca22fa240 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:57.835111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27b10ab52bf40a0bcf253f21f9e344e', 'request_id': 'req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.847000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27b10ab52bf40a0bcf253f21f9e344e', 'request_id': 'req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.856850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:57.874352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:57.874502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] The token cache is being invalidate because project a27b10ab52bf40a0bcf253f21f9e344e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:57.874742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.878596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:57.884559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1010/2008] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:57 2022] DELETE /identity/v3/projects/a27b10ab52bf40a0bcf253f21f9e344e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:57.887221 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:57.888721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:57.919921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:57.920793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:57.921158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:57.921558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:57.924113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:57.927403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:57.966787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 999/2009] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:57 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:57.971061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:57.974178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec4d43-8feb-44f9-ab2a-a7a4d00d1856 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:57.981789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:58.115520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:58.117154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038945f-ff0a-45ff-8f4c-22217f63d1e0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:58.118855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.119752 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.120251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] PATH_INFO: `/v3/users/d0c1e33107e34e26a59a8e065163457b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.121973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c1e33107e34e26a59a8e065163457b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:58.124022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:58.124984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:58.125204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.127146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.127146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.128126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:58.131600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:58.159135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1000/2010] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:57 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:58.163599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:58.181965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f756c-6de2-4de4-91f4-90eccfeb3e2f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:58.189419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:58.191574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.192048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.192448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.193402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:58.195759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:58.201529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c1e33107e34e26a59a8e065163457b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.208878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1001/2011] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:58.212764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:58.220936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c1e33107e34e26a59a8e065163457b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.222078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c1e33107e34e26a59a8e065163457b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.227506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8280d3a-0f5b-4f7e-8e15-2e7188edf776 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:58.238524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:58.239845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.240138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.240421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.241546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:58.244056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:58.248445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c1e33107e34e26a59a8e065163457b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.250248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3f08008d-6542-4d26-b6a8-8a68af3b0f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c1e33107e34e26a59a8e065163457b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.264397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1002/2012] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:57:58.265582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:58.268966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:58.287700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f6171-d93b-47af-b949-92210c01dc50 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:58.295063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:58.296875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.297279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.298353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] PATH_INFO: `/v3/projects/bb5866c407a44834934130fba59c2e79/users/61483e03ddf8498d8139a6e52c4bd6f9/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.304184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1011/2013] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:57:57 2022] DELETE /identity/v3/users/d0c1e33107e34e26a59a8e065163457b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:58.349667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5866c407a44834934130fba59c2e79, user_id=61483e03ddf8498d8139a6e52c4bd6f9, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:58.352994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:58.381847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1003/2014] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:58 2022] PUT /identity/v3/projects/bb5866c407a44834934130fba59c2e79/users/61483e03ddf8498d8139a6e52c4bd6f9/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:57:58.394840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.394840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.394840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.435094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] MFA Rules not processed for user `61483e03ddf8498d8139a6e52c4bd6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:58.436810 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:58.460285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:58.559308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:58.561775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:58.574548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1012/2015] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:58.575705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:58.577307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:58.663825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ce372-2e70-4520-9c28-84fef197786e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:58.667663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad698f92-4d71-4d49-87e3-2cf959fd3659 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:58.668331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698f92-4d71-4d49-87e3-2cf959fd3659 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.668677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698f92-4d71-4d49-87e3-2cf959fd3659 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.668966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698f92-4d71-4d49-87e3-2cf959fd3659 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.678187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209de4a-9c49-454f-920e-df341af4b5bc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:58.679589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad698f92-4d71-4d49-87e3-2cf959fd3659 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:58.681155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad698f92-4d71-4d49-87e3-2cf959fd3659 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:58.683832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:58.685257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.685653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.686596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] PATH_INFO: `/v3/projects/5c0ac1acdb6b4785bbcd4366070a0591` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.688967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0ac1acdb6b4785bbcd4366070a0591)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:58.691477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:58.692388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1013/2016] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:57:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:57:58.701630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:58.793353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0ac1acdb6b4785bbcd4366070a0591', 'request_id': 'req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.802826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0ac1acdb6b4785bbcd4366070a0591', 'request_id': 'req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.810602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0ac1acdb6b4785bbcd4366070a0591', 'request_id': 'req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.829367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] The token cache is being invalidate because project 5c0ac1acdb6b4785bbcd4366070a0591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:57:58.829967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.834403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03bb7ab5-f309-4ccc-b1ab-812b44a9549b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:57:58.836995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1004/2017] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:57:58 2022] DELETE /identity/v3/projects/5c0ac1acdb6b4785bbcd4366070a0591 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:58.844131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d395e-3529-4515-aed8-040a7b9a6108 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.844472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d395e-3529-4515-aed8-040a7b9a6108 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.845686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d395e-3529-4515-aed8-040a7b9a6108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:58.883359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6b9d395e-3529-4515-aed8-040a7b9a6108 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:58.892540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6b9d395e-3529-4515-aed8-040a7b9a6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:58.986443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1014/2018] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:58.994664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7eb0a-947c-49f9-a343-9f72089ce5ae None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:58.994966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7eb0a-947c-49f9-a343-9f72089ce5ae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:58.995259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7eb0a-947c-49f9-a343-9f72089ce5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.038872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dba7eb0a-947c-49f9-a343-9f72089ce5ae None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:59.040126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dba7eb0a-947c-49f9-a343-9f72089ce5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:59.052299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1005/2019] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:59.056167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d395e-3529-4515-aed8-040a7b9a6108 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.067446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d395e-3529-4515-aed8-040a7b9a6108 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.072332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.073013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.073424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.073580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.075214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:57:59.075536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.077170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.091653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1015/2020] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:57:59.096743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7eb0a-947c-49f9-a343-9f72089ce5ae None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.108091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7eb0a-947c-49f9-a343-9f72089ce5ae None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.115982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.116742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.117123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.117490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.118397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.120492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.155418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1006/2021] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:59 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:59.160654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.172159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c91c3-d67c-40d6-aed1-15c98dd966fa admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.240592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:59.264899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.265819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.266131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.267402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.268078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.270150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.301414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1016/2022] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:59 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:59.305633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.325270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce50b2-d7ce-40f1-b54e-7ed974f3d566 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.340987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.341681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.341992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.342273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.343003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.344663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.372686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1007/2023] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:59.378441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.414721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcba7b-0d30-4c56-ad71-f8ab213b729e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.426674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f81e76-6764-44ef-8e1f-269013ae9f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.427360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81e76-6764-44ef-8e1f-269013ae9f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.427731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81e76-6764-44ef-8e1f-269013ae9f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.428087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81e76-6764-44ef-8e1f-269013ae9f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.428829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f81e76-6764-44ef-8e1f-269013ae9f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.432332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f81e76-6764-44ef-8e1f-269013ae9f3d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.444655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1017/2024] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:59.448926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.461593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7778f1-47f5-4533-8119-4681a3b3a6c3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.477505 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.478557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.478869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.479121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] PATH_INFO: `/v3/projects/65576ce6046143b8ab93ed345b408d36/users/581e77a8384c47a2ba958d5bb9029ca6/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.498971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65576ce6046143b8ab93ed345b408d36, user_id=581e77a8384c47a2ba958d5bb9029ca6, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.503926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.520355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1008/2025] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:59 2022] PUT /identity/v3/projects/65576ce6046143b8ab93ed345b408d36/users/581e77a8384c47a2ba958d5bb9029ca6/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:59.530749 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e8ad-a868-4a71-a43e-bf26ff5bc370 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.531307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e8ad-a868-4a71-a43e-bf26ff5bc370 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.531599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e8ad-a868-4a71-a43e-bf26ff5bc370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.560660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3005e8ad-a868-4a71-a43e-bf26ff5bc370 None None] MFA Rules not processed for user `581e77a8384c47a2ba958d5bb9029ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:57:59.561913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3005e8ad-a868-4a71-a43e-bf26ff5bc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:57:59.632358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1018/2026] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:57:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:57:59.636825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.697808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77c18-639c-4f42-87c1-1c867871ffa4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.702430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.703083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.703370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.703675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.704370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.706335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.730720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1009/2027] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:57:59 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:59.735474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005e8ad-a868-4a71-a43e-bf26ff5bc370 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.746056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005e8ad-a868-4a71-a43e-bf26ff5bc370 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.803750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.804446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.804732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.805006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.805702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.807674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.828348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1019/2028] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:57:59 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:57:59.832725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.843410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc46f-176d-4db2-9aa0-4f0280b35152 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.848862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.849688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.850013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.850317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.851039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.852629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.864802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1010/2029] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:57:59.869039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.879144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c996b-8f57-4621-98b6-ce94bf32a609 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:57:59.883617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:57:59.884487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:57:59.884770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:57:59.885051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] PATH_INFO: `/v3/projects/f29ff9fdce944ba1a9c375137f60723b/users/2d9061e6ead445098cc3e9e3f0a47342/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:57:59.901179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29ff9fdce944ba1a9c375137f60723b, user_id=2d9061e6ead445098cc3e9e3f0a47342, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:57:59.907726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:57:59.926525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1020/2030] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:57:59 2022] PUT /identity/v3/projects/f29ff9fdce944ba1a9c375137f60723b/users/2d9061e6ead445098cc3e9e3f0a47342/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:57:59.930586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:57:59.937461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:59.941399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6c6b-7e44-4196-84d0-5ad36fd436ca admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:00.009030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a19799-8c2d-4a7f-a95f-3b185f19ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:00.009703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19799-8c2d-4a7f-a95f-3b185f19ba2b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:00.010020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19799-8c2d-4a7f-a95f-3b185f19ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:00.010295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19799-8c2d-4a7f-a95f-3b185f19ba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:00.011012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a19799-8c2d-4a7f-a95f-3b185f19ba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:00.012593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a19799-8c2d-4a7f-a95f-3b185f19ba2b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:00.026204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1011/2031] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:00.027357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:00.038273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004259-444a-4e30-b586-8f10c1669c02 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:00.042868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:00.043737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:00.044029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:00.044307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] PATH_INFO: `/v3/projects/f29ff9fdce944ba1a9c375137f60723b/users/2d9061e6ead445098cc3e9e3f0a47342/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:00.046316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29ff9fdce944ba1a9c375137f60723b, user_id=2d9061e6ead445098cc3e9e3f0a47342, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:00.049523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:00.061439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1021/2032] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:00 2022] PUT /identity/v3/projects/f29ff9fdce944ba1a9c375137f60723b/users/2d9061e6ead445098cc3e9e3f0a47342/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:00.072583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145c87-fbec-4e21-a0e1-e60a03499902 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:00.072816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145c87-fbec-4e21-a0e1-e60a03499902 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:00.073101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145c87-fbec-4e21-a0e1-e60a03499902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:00.104078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ee145c87-fbec-4e21-a0e1-e60a03499902 None None] MFA Rules not processed for user `2d9061e6ead445098cc3e9e3f0a47342`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:00.105273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ee145c87-fbec-4e21-a0e1-e60a03499902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:00.199905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1012/2033] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:00.213503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:00.216081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:00.225628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:00.319901 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b050157-5d6b-4c23-a5ac-0b3d8ae38e0b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:00.324002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:00.324656 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:00.324943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:00.325218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:00.392592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:00.394175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:00.404971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1022/2034] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:10.100740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee145c87-fbec-4e21-a0e1-e60a03499902 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:10.110520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee145c87-fbec-4e21-a0e1-e60a03499902 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:10.114077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e676-8c9a-43bc-aee3-714636eab6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:10.114719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e676-8c9a-43bc-aee3-714636eab6fb service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:10.115005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e676-8c9a-43bc-aee3-714636eab6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:10.115285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e676-8c9a-43bc-aee3-714636eab6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:10.124538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e676-8c9a-43bc-aee3-714636eab6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:10.126027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e676-8c9a-43bc-aee3-714636eab6fb service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:10.135605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1013/2035] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:10.399800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=46 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:12.894598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:12.896215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:12.980555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3f01f-edf0-4be1-a02f-7daa69f89404 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:12.985923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:12.986862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:12.987158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:12.987439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] PATH_INFO: `/v3/users/e58d378de3874c648a511c45015f5f16` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:12.988746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58d378de3874c648a511c45015f5f16)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:12.990953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:13.062930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58d378de3874c648a511c45015f5f16'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.072107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58d378de3874c648a511c45015f5f16'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.072909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58d378de3874c648a511c45015f5f16'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.084631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58d378de3874c648a511c45015f5f16'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.085382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58d378de3874c648a511c45015f5f16'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.112446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1023/2036] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:12 2022] DELETE /identity/v3/users/e58d378de3874c648a511c45015f5f16 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:13.116869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:13.117469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:13.117469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:13.136105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:13.137543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:13.200391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1014/2037] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:13.211188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:13.212943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:13.275451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32884a-ec21-42d9-b71d-d16440791a37 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:13.279355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac2ef-9b1b-42df-9c3f-2ce48887dd1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:13.280072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac2ef-9b1b-42df-9c3f-2ce48887dd1d service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:13.280364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac2ef-9b1b-42df-9c3f-2ce48887dd1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:13.280661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac2ef-9b1b-42df-9c3f-2ce48887dd1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:13.292626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac2ef-9b1b-42df-9c3f-2ce48887dd1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:13.294146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac2ef-9b1b-42df-9c3f-2ce48887dd1d service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:13.303990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1024/2038] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:13.606419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:13.607855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:13.622276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce87b4-1d8b-41b4-ad3b-5082d1d98554 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:13.627914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:13.629413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:13.629413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:13.629413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] PATH_INFO: `/v3/projects/5307889243b44f40a6c897680dd1ec93` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:13.631172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5307889243b44f40a6c897680dd1ec93)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:13.633544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:13.643797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:13.701280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5307889243b44f40a6c897680dd1ec93', 'request_id': 'req-2836c188-7849-4220-8eca-1a193363e0da'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.704495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5307889243b44f40a6c897680dd1ec93', 'request_id': 'req-2836c188-7849-4220-8eca-1a193363e0da'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.710023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5307889243b44f40a6c897680dd1ec93', 'request_id': 'req-2836c188-7849-4220-8eca-1a193363e0da'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.723084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] The token cache is being invalidate because project 5307889243b44f40a6c897680dd1ec93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:13.723370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.723986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2836c188-7849-4220-8eca-1a193363e0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:13.725523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1015/2039] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:13 2022] DELETE /identity/v3/projects/5307889243b44f40a6c897680dd1ec93 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:13.730550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664558dc-dca7-4432-9568-3eca30999e40 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:13.730843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664558dc-dca7-4432-9568-3eca30999e40 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:13.731124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664558dc-dca7-4432-9568-3eca30999e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:13.751044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-664558dc-dca7-4432-9568-3eca30999e40 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:13.752269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-664558dc-dca7-4432-9568-3eca30999e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:13.773204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:13.826035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1025/2040] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:13.834518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b243-de03-428a-851c-246c465f7b25 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:13.834753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b243-de03-428a-851c-246c465f7b25 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:13.835041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b243-de03-428a-851c-246c465f7b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:13.854419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a175b243-de03-428a-851c-246c465f7b25 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:13.855680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a175b243-de03-428a-851c-246c465f7b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:13.870716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1016/2041] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:13.875035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664558dc-dca7-4432-9568-3eca30999e40 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:13.885716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664558dc-dca7-4432-9568-3eca30999e40 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:13.897149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:13.897897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:13.898782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:13.899080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:13.899960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:13.900283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:13.901960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:13.923577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1026/2042] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:58:13.924641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175b243-de03-428a-851c-246c465f7b25 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:13.934388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175b243-de03-428a-851c-246c465f7b25 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:13.939660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:13.940307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:13.940590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:13.940865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:13.941546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:13.943474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:13.968845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1017/2043] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:13 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:13.973018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:13.984182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b686-4251-4602-b35b-5809ca8f0568 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.046415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.047163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.048227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.048517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.049226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.051202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.071332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1027/2044] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:13 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:14.075454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.085654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6cdd-42ba-45c6-ad37-a4b5445d3af6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.090307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.090966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.091257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.091540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.092263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.093915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.104950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1018/2045] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:14.108488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.119131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf58b-59f2-4608-88ce-34da98323deb admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.123716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91524e0d-dbd7-49da-ac4b-e3397ffe90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.124371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524e0d-dbd7-49da-ac4b-e3397ffe90e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.124652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524e0d-dbd7-49da-ac4b-e3397ffe90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.124928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524e0d-dbd7-49da-ac4b-e3397ffe90e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.125674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91524e0d-dbd7-49da-ac4b-e3397ffe90e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.127282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91524e0d-dbd7-49da-ac4b-e3397ffe90e7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.140027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1028/2046] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:14.141517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.151832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909bda-17d1-4adb-b6e0-f3beb1135943 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.157174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.158088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.158375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.158651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] PATH_INFO: `/v3/projects/4dbc95b61a084dc8852991e13166a911/users/87bcbe4b84124c6f9da6d3d14c19d8f6/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.173634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbc95b61a084dc8852991e13166a911, user_id=87bcbe4b84124c6f9da6d3d14c19d8f6, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.176314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.190677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1019/2047] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:14 2022] PUT /identity/v3/projects/4dbc95b61a084dc8852991e13166a911/users/87bcbe4b84124c6f9da6d3d14c19d8f6/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:14.201055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff5e17-ff57-4f62-bb34-153889a87797 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.201347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff5e17-ff57-4f62-bb34-153889a87797 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.201678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff5e17-ff57-4f62-bb34-153889a87797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.230098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-99ff5e17-ff57-4f62-bb34-153889a87797 None None] MFA Rules not processed for user `87bcbe4b84124c6f9da6d3d14c19d8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:14.231311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-99ff5e17-ff57-4f62-bb34-153889a87797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:14.305557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1029/2048] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:14.310070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.381968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c649d-0eae-47f7-b37b-9e1653bb95c8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.387072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.387626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.387907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.388188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.388997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.391011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.420498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1020/2049] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:14 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:14.426375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff5e17-ff57-4f62-bb34-153889a87797 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.437203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff5e17-ff57-4f62-bb34-153889a87797 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.449600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:14.497677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.498425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.498710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.499017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.499709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.501637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.521682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1030/2050] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:14 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:14.525490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.536573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815726bd-05c5-4bd2-92ef-3307ea41abbd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.541257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.542185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.542432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.542733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.543531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.545894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.568532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1021/2051] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:14.572747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.584176 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626839c-3129-430d-a145-85466ae8fdc2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.590189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1c42c-cef9-47ad-a6aa-8672d54dca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.591294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1c42c-cef9-47ad-a6aa-8672d54dca99 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.591294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1c42c-cef9-47ad-a6aa-8672d54dca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.591517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1c42c-cef9-47ad-a6aa-8672d54dca99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.592131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1c42c-cef9-47ad-a6aa-8672d54dca99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.593863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1c42c-cef9-47ad-a6aa-8672d54dca99 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.612820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1031/2052] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:14.616969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.627209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469e6d4-d467-4ab7-9370-7264f02c95f5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.632885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.633899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.634253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.634940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] PATH_INFO: `/v3/projects/d6422fba8fb840ac8512bb2f585a35e8/users/b33d32cb828b4ed69cc52844eaf921ed/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.637310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:14.654798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6422fba8fb840ac8512bb2f585a35e8, user_id=b33d32cb828b4ed69cc52844eaf921ed, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.658662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.672647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1022/2053] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:14 2022] PUT /identity/v3/projects/d6422fba8fb840ac8512bb2f585a35e8/users/b33d32cb828b4ed69cc52844eaf921ed/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:14.682855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b12-8e95-4961-88ca-a1bed1cb5a02 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.683155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b12-8e95-4961-88ca-a1bed1cb5a02 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.683438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b12-8e95-4961-88ca-a1bed1cb5a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.711995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b6223b12-8e95-4961-88ca-a1bed1cb5a02 None None] MFA Rules not processed for user `b33d32cb828b4ed69cc52844eaf921ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:14.713260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b6223b12-8e95-4961-88ca-a1bed1cb5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:14.789617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1032/2054] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:14.794222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.861325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f12ca-a54b-4956-b73a-5af87b0c0209 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.866718 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.867642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.867931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.868228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.868897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.870840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:14.900094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1023/2055] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:14 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:14.904610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6223b12-8e95-4961-88ca-a1bed1cb5a02 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.917001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6223b12-8e95-4961-88ca-a1bed1cb5a02 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:14.962418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:14.964326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:14.985332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:14.986282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:14.986962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:14.987298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:14.988010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:14.990101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.015249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1033/2056] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:14 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:15.017417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:15.028226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542beb-32ff-41bd-b72b-791837c74e25 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.033351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.034059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.034351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.034701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.035421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.037109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.039919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b5e38-ef91-4263-833f-db40f0330ee7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.045190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.046883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.047051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.050676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] PATH_INFO: `/v3/users/5a91bcb445094e7cb4cd8fd66ea27aeb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.050921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1034/2057] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:15.051007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a91bcb445094e7cb4cd8fd66ea27aeb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.051007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.052159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:15.059097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:15.063494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7942dc1-b89e-40e3-ae16-dff00aba4243 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.069368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.070693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.071218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.071885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] PATH_INFO: `/v3/projects/0dde3120d6b544358f03d64f10e067f3/users/e0223c90e74248f09c379ee14a959199/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.091179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dde3120d6b544358f03d64f10e067f3, user_id=e0223c90e74248f09c379ee14a959199, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.094519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.108731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1035/2058] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:15 2022] PUT /identity/v3/projects/0dde3120d6b544358f03d64f10e067f3/users/e0223c90e74248f09c379ee14a959199/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:15.109963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a91bcb445094e7cb4cd8fd66ea27aeb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.113452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:15.117633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a91bcb445094e7cb4cd8fd66ea27aeb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.118347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a91bcb445094e7cb4cd8fd66ea27aeb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.126868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a91bcb445094e7cb4cd8fd66ea27aeb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.127854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a4a94d29-d425-41f3-abbb-4c4fa7a3aa0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a91bcb445094e7cb4cd8fd66ea27aeb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.133265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:15.148869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1024/2059] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:14 2022] DELETE /identity/v3/users/5a91bcb445094e7cb4cd8fd66ea27aeb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:15.153128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.153449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.153738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.171754 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:15.173480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:15.184253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846830db-b5b4-42fc-9729-6243b2f55097 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.240950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1025/2060] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:15.248278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.248952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.249345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.249521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.250361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:15.251014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.252201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:15.253201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.271572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1036/2061] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:15.272855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:15.275170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:15.287919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6803-e326-4338-bb34-d91c42b51eac admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.292621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dde0f-409e-4ea3-9818-0d3340c10290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.293500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dde0f-409e-4ea3-9818-0d3340c10290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.293827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dde0f-409e-4ea3-9818-0d3340c10290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.294112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dde0f-409e-4ea3-9818-0d3340c10290 admin admin] PATH_INFO: `/v3/projects/0dde3120d6b544358f03d64f10e067f3/users/e0223c90e74248f09c379ee14a959199/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.296108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dde0f-409e-4ea3-9818-0d3340c10290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dde3120d6b544358f03d64f10e067f3, user_id=e0223c90e74248f09c379ee14a959199, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.299292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dde0f-409e-4ea3-9818-0d3340c10290 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.310861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1037/2062] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:15 2022] PUT /identity/v3/projects/0dde3120d6b544358f03d64f10e067f3/users/e0223c90e74248f09c379ee14a959199/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:15.314875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe3989-0430-48a9-ad03-9c340ec8a5a4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.322514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.322972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.323267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.349454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] MFA Rules not processed for user `e0223c90e74248f09c379ee14a959199`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:15.350674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:15.363013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.363602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.363893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.364175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.428025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:15.441808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1038/2063] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:15.442167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:15.448298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.450530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.453904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:15.455688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:15.463330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1026/2064] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:15.517459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9e969-48d8-40de-8f62-7de9bf4d9a08 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.521641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.522720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.522720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.522934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.524713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:15.602311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.603860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.613709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1039/2065] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:15.831114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:15.832553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:15.845409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0495-372a-47d9-8097-b589c055d53c service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:15.850873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:15.851883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:15.852269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:15.852766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] PATH_INFO: `/v3/projects/98cbd0d4c732471b9c8ab6bf92f6f05c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:15.854137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cbd0d4c732471b9c8ab6bf92f6f05c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:15.856736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:15.951527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cbd0d4c732471b9c8ab6bf92f6f05c', 'request_id': 'req-a8e06b35-8184-49bd-9715-7c4d4c03b12d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.959604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cbd0d4c732471b9c8ab6bf92f6f05c', 'request_id': 'req-a8e06b35-8184-49bd-9715-7c4d4c03b12d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.966077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cbd0d4c732471b9c8ab6bf92f6f05c', 'request_id': 'req-a8e06b35-8184-49bd-9715-7c4d4c03b12d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.984214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] The token cache is being invalidate because project 98cbd0d4c732471b9c8ab6bf92f6f05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:15.985325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.986134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:15.988138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1027/2066] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:15 2022] DELETE /identity/v3/projects/98cbd0d4c732471b9c8ab6bf92f6f05c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:15.992154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.005117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6f88-2f79-4552-9fe2-12e9d94a36dd service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.079859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.080737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.081275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.081395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] PATH_INFO: `/v3/users/bda94b8fefcb41efab3a6d9e609cfc9a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.082635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda94b8fefcb41efab3a6d9e609cfc9a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.084563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.098025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.098025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.113533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e06b35-8184-49bd-9715-7c4d4c03b12d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.118631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.119516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.119816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.120074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] PATH_INFO: `/v3/users/581e77a8384c47a2ba958d5bb9029ca6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.121380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581e77a8384c47a2ba958d5bb9029ca6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.123300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.133800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda94b8fefcb41efab3a6d9e609cfc9a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.138534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:16.142450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda94b8fefcb41efab3a6d9e609cfc9a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.143096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda94b8fefcb41efab3a6d9e609cfc9a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.152617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda94b8fefcb41efab3a6d9e609cfc9a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.153265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c88ee55d-52f0-4445-8afc-902f5980a538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda94b8fefcb41efab3a6d9e609cfc9a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.171941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1040/2067] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:15 2022] DELETE /identity/v3/users/bda94b8fefcb41efab3a6d9e609cfc9a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:16.175722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581e77a8384c47a2ba958d5bb9029ca6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.181280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581e77a8384c47a2ba958d5bb9029ca6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.182002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581e77a8384c47a2ba958d5bb9029ca6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.190623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581e77a8384c47a2ba958d5bb9029ca6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.191235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581e77a8384c47a2ba958d5bb9029ca6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.214752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1028/2068] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:16 2022] DELETE /identity/v3/users/581e77a8384c47a2ba958d5bb9029ca6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:16.219638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.220262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.220782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.240938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:16.241917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.309982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1041/2069] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:16.321392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.323094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.380962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:16.391035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b33f7-52d4-4f06-b9f1-cfbe97cc9c66 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.394874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f4ac-1b13-40f2-95ad-0862e56f37fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.395538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f4ac-1b13-40f2-95ad-0862e56f37fc service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.395825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f4ac-1b13-40f2-95ad-0862e56f37fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.396279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f4ac-1b13-40f2-95ad-0862e56f37fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.405876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f4ac-1b13-40f2-95ad-0862e56f37fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.408133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f4ac-1b13-40f2-95ad-0862e56f37fc service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.417596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1029/2070] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:16.478030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.479507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.492176 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd4a4-8335-4bea-8394-b0ce3e171008 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.498448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.499558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.500540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.500926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] PATH_INFO: `/v3/projects/99c97ced16054be9922ee61f83ace995` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.502677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c97ced16054be9922ee61f83ace995)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.504716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.557827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c97ced16054be9922ee61f83ace995', 'request_id': 'req-93d05408-dd64-436b-b406-144056663e45'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.568703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c97ced16054be9922ee61f83ace995', 'request_id': 'req-93d05408-dd64-436b-b406-144056663e45'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.578234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c97ced16054be9922ee61f83ace995', 'request_id': 'req-93d05408-dd64-436b-b406-144056663e45'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.596031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] The token cache is being invalidate because project 99c97ced16054be9922ee61f83ace995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:16.596031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.596031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-93d05408-dd64-436b-b406-144056663e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.599352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1042/2071] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:16 2022] DELETE /identity/v3/projects/99c97ced16054be9922ee61f83ace995 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:16.606218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.606541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.606828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.629513 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:16.630837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.702826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1030/2072] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:16.711026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d1a7-bc44-4eb8-a8b6-cba57e1563ba None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.711465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d1a7-bc44-4eb8-a8b6-cba57e1563ba None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.712030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d1a7-bc44-4eb8-a8b6-cba57e1563ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.733184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-44c3d1a7-bc44-4eb8-a8b6-cba57e1563ba None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:16.734611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-44c3d1a7-bc44-4eb8-a8b6-cba57e1563ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.745970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1043/2073] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:16.748196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.751150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d1a7-bc44-4eb8-a8b6-cba57e1563ba None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.752160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.760960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d1a7-bc44-4eb8-a8b6-cba57e1563ba None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.766625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.767439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.767772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.768060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.768902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:16.769217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.771043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.782809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171fb21-3b60-4ade-b5a3-4741506056a6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.785369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1044/2074] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:58:16.787849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.788801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.789216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.789504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] PATH_INFO: `/v3/projects/65576ce6046143b8ab93ed345b408d36` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.789898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.790759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=65576ce6046143b8ab93ed345b408d36)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.792829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.799511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b7f58-8967-4503-9a8b-da66ebe1fb01 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.804224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.804846 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.805138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.805420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.806138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.808022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.837432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1045/2075] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:16 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:16.838407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.845538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65576ce6046143b8ab93ed345b408d36', 'request_id': 'req-14933b32-4cc6-4b42-b1a1-29484645bfdf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.851192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:16.851801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65576ce6046143b8ab93ed345b408d36', 'request_id': 'req-14933b32-4cc6-4b42-b1a1-29484645bfdf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.857719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65576ce6046143b8ab93ed345b408d36', 'request_id': 'req-14933b32-4cc6-4b42-b1a1-29484645bfdf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.870824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] The token cache is being invalidate because project 65576ce6046143b8ab93ed345b408d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:16.871119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.871766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:16.873682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1031/2076] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:16 2022] DELETE /identity/v3/projects/65576ce6046143b8ab93ed345b408d36 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:16.877298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.878638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.903818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccbedd-a9c5-4ad9-94cd-0778b4c33c43 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.909273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.909976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.910266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.911072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.911370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.913610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.933350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1046/2077] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:16 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:16.937451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.939091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:16.943897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14933b32-4cc6-4b42-b1a1-29484645bfdf admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.949112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.950082 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.950438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.950734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] PATH_INFO: `/v3/users/2d9061e6ead445098cc3e9e3f0a47342` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.951095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6907-bad8-4598-99f0-cf367bd60f53 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.952056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9061e6ead445098cc3e9e3f0a47342)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.954563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.956478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.957132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.957413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.957691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.958504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.960110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:16.970806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1047/2078] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:16.971000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:16.974762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:16.984981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003439-bd48-4e9a-9fa4-31d21ac5f5af admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:16.990140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:16.990790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:16.991080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:16.991358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:16.992086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:16.993691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.007090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1048/2079] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:17.008347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9061e6ead445098cc3e9e3f0a47342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.011504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.017968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9061e6ead445098cc3e9e3f0a47342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.018704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9061e6ead445098cc3e9e3f0a47342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.022995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531e39e-1296-44eb-b4ee-585d3392a22b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.028108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.028677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9061e6ead445098cc3e9e3f0a47342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.029064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.029367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.029633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] PATH_INFO: `/v3/projects/ee933809ee5e4129b3d2b8712e3f008b/users/b5c22ac0f98b466096b03cf99d983464/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.035836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b5ab3a7-679e-44b0-ac3c-88d6036ff383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9061e6ead445098cc3e9e3f0a47342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.049381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee933809ee5e4129b3d2b8712e3f008b, user_id=b5c22ac0f98b466096b03cf99d983464, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.052324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.061103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1032/2080] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:16 2022] DELETE /identity/v3/users/2d9061e6ead445098cc3e9e3f0a47342 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:17.076373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1049/2081] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:17 2022] PUT /identity/v3/projects/ee933809ee5e4129b3d2b8712e3f008b/users/b5c22ac0f98b466096b03cf99d983464/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:17.088169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.088169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.088545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.125728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] MFA Rules not processed for user `b5c22ac0f98b466096b03cf99d983464`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:17.127327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.219094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1033/2082] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:17.223557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.226468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.290712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.292598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.342532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700656-c484-4b85-9f6e-c70e2cbf0e87 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.348503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.349492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.349800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.350391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.350785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.353029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.362266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcb3da-b328-4933-9e73-c087c71d4880 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.367421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.368176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.368522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.368900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.371594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.384967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1050/2083] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:17.392620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.432782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:17.445216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:17.455672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.457188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.465909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a132-8266-43ae-ad0e-f701ca71f2af admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.466069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1034/2084] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:17.466858 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.468127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.472517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.473183 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.473552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.473742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.474468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.476417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.481572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85260e-5cff-47aa-af5c-ee2364cebbf7 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.487676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.488591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.488950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.489301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] PATH_INFO: `/v3/projects/f29ff9fdce944ba1a9c375137f60723b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.490563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29ff9fdce944ba1a9c375137f60723b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.492482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.504943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1051/2085] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:17.511745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.524409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d7199-2af5-4021-9b10-9619d4b61cd5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.530044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.530973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.531715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.532016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.532756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.534438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.545786 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1052/2086] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:17.550066 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.553724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29ff9fdce944ba1a9c375137f60723b', 'request_id': 'req-70de205f-df1a-4c83-9f50-d5fbdc3eb808'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.560057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bebb0-7acf-4d81-9b44-ee362b1b8a5a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.561074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29ff9fdce944ba1a9c375137f60723b', 'request_id': 'req-70de205f-df1a-4c83-9f50-d5fbdc3eb808'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.568494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29ff9fdce944ba1a9c375137f60723b', 'request_id': 'req-70de205f-df1a-4c83-9f50-d5fbdc3eb808'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.585638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] The token cache is being invalidate because project f29ff9fdce944ba1a9c375137f60723b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:17.586343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.586662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-70de205f-df1a-4c83-9f50-d5fbdc3eb808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:17.588260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1035/2087] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:17 2022] DELETE /identity/v3/projects/f29ff9fdce944ba1a9c375137f60723b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:17.594548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b480-3cda-47f7-bf12-246c1da5a8a7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.594843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b480-3cda-47f7-bf12-246c1da5a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.595185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b480-3cda-47f7-bf12-246c1da5a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.615516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9600b480-3cda-47f7-bf12-246c1da5a8a7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:17.616833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9600b480-3cda-47f7-bf12-246c1da5a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.642829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.643545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.643830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.644109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.644843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.646582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.658571 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1053/2088] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:17.662874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.664907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.678600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04d504-3caa-4796-bdc3-882cefda335f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.683346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde872e0-e05d-42fd-bb21-d51423f8dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.684230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde872e0-e05d-42fd-bb21-d51423f8dd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.684512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde872e0-e05d-42fd-bb21-d51423f8dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.684792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde872e0-e05d-42fd-bb21-d51423f8dd16 admin admin] PATH_INFO: `/v3/projects/04244410583341d08d2c7bcecb56671b/users/c14e14ec148c4c01bc8e055248cfe114/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.700416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde872e0-e05d-42fd-bb21-d51423f8dd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04244410583341d08d2c7bcecb56671b, user_id=c14e14ec148c4c01bc8e055248cfe114, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.702862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1036/2089] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:17.703095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde872e0-e05d-42fd-bb21-d51423f8dd16 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.712703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389970-e86d-460e-acb2-6f85efe9b915 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.713247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389970-e86d-460e-acb2-6f85efe9b915 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.713832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389970-e86d-460e-acb2-6f85efe9b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.716535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1054/2090] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:17 2022] PUT /identity/v3/projects/04244410583341d08d2c7bcecb56671b/users/c14e14ec148c4c01bc8e055248cfe114/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:17.727534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fc12f-f804-4b51-858e-2b93b374616a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.727838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fc12f-f804-4b51-858e-2b93b374616a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.728138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fc12f-f804-4b51-858e-2b93b374616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.737275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-36389970-e86d-460e-acb2-6f85efe9b915 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:17.738597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-36389970-e86d-460e-acb2-6f85efe9b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.760600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4e3fc12f-f804-4b51-858e-2b93b374616a None None] MFA Rules not processed for user `c14e14ec148c4c01bc8e055248cfe114`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:17.761976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4e3fc12f-f804-4b51-858e-2b93b374616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:17.815696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1037/2091] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:17.820088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36389970-e86d-460e-acb2-6f85efe9b915 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.824762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:17.830053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36389970-e86d-460e-acb2-6f85efe9b915 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.838585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.839265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.839552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.839838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.840774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:17.841167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.843212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.845861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1055/2092] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:17.849961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fc12f-f804-4b51-858e-2b93b374616a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.860610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1038/2093] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:58:17.866071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.868743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fc12f-f804-4b51-858e-2b93b374616a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.876239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.876912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.877200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.877478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.878379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.880311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.881960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8842eb-a7a6-441a-a95b-7edce3a5a0ed admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:17.887454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:17.888110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:17.888402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:17.889789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:17.889789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:17.891610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:17.901186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:17.913438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1056/2094] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:17.919389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:17.928367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1039/2095] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:17.933342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.015341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8f9de-f69e-4201-afd1-bb337ed4d58e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.016423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365d64d-ae7e-48ce-abf1-f04880fabde8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.021016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.021819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.022182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.022534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.023307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.023859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.024593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.024952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.025304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.025600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.026270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.028583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.057737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1040/2096] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:18.060855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1057/2097] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:17 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:18.060993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.062088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.072136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb99ad0-e3b9-4755-ac38-4bc72eb7ef4d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.080745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.081569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.082097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.082506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.083247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.083735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11662a5d-8cde-4e3c-844d-8a3e90b2c570 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.085097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.089544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.090255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.090748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.091463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.092258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.094411 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.097306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1041/2098] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:18.102717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.110258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1058/2099] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:18.114305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4dfc9-5fc3-43f0-b3ad-81d89ff750d3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.114750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.119123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.119821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.120109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.120397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.121427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.123062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.127506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dc7d-7aab-48a3-930d-5add7b76adc7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.134208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1042/2100] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:18.135214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.138349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.138455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.138806 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.138993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] PATH_INFO: `/v3/projects/4190799c9dfc40268923d447fb0fbd7a/users/c493b870c1174f49afb2ceaf29d78afd/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.153035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a3a3f-f544-4101-b3a3-512038e34560 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.158123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4190799c9dfc40268923d447fb0fbd7a, user_id=c493b870c1174f49afb2ceaf29d78afd, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.159861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.160384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.162385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.162978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.163419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] PATH_INFO: `/v3/projects/5ea89aad83784931bd36e16c29cbe523/users/1fc9449568974c5a8df1657ac30f284e/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.181796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1059/2101] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:18 2022] PUT /identity/v3/projects/4190799c9dfc40268923d447fb0fbd7a/users/c493b870c1174f49afb2ceaf29d78afd/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:18.181796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.186667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:18.196669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea89aad83784931bd36e16c29cbe523, user_id=1fc9449568974c5a8df1657ac30f284e, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.200114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.221862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1043/2102] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:18 2022] PUT /identity/v3/projects/5ea89aad83784931bd36e16c29cbe523/users/1fc9449568974c5a8df1657ac30f284e/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:18.222859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.259699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30b41-2485-484f-80e1-a64e4dab26b2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.301715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd6f8-f16a-44a7-becf-573316c11655 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.307710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf15311-5c98-4c1b-bb5e-02c76b86b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.308914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf15311-5c98-4c1b-bb5e-02c76b86b068 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.309202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf15311-5c98-4c1b-bb5e-02c76b86b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.309487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf15311-5c98-4c1b-bb5e-02c76b86b068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.310476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf15311-5c98-4c1b-bb5e-02c76b86b068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.312390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf15311-5c98-4c1b-bb5e-02c76b86b068 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.322717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.323832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.324195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.324545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.324649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1044/2103] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:18.326804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e9f2-3487-4214-b824-b61f9aafd96b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.326804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e9f2-3487-4214-b824-b61f9aafd96b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.326804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e9f2-3487-4214-b824-b61f9aafd96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.328195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:18.344063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:18.356555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:18.360998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-76b2e9f2-3487-4214-b824-b61f9aafd96b None None] MFA Rules not processed for user `1fc9449568974c5a8df1657ac30f284e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:18.362946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-76b2e9f2-3487-4214-b824-b61f9aafd96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:18.424529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.426160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.436342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1060/2104] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:18.437785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.447720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1045/2105] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:18.450586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a1ae-e5ed-41ae-8988-1bddcc998842 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.451941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e9f2-3487-4214-b824-b61f9aafd96b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.459824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f745496-cb4b-4507-81cb-07c52b9e3c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.465300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f745496-cb4b-4507-81cb-07c52b9e3c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.465714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f745496-cb4b-4507-81cb-07c52b9e3c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.466755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f745496-cb4b-4507-81cb-07c52b9e3c55 admin admin] PATH_INFO: `/v3/projects/4190799c9dfc40268923d447fb0fbd7a/users/c493b870c1174f49afb2ceaf29d78afd/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.470316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e9f2-3487-4214-b824-b61f9aafd96b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.474218 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f745496-cb4b-4507-81cb-07c52b9e3c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4190799c9dfc40268923d447fb0fbd7a, user_id=c493b870c1174f49afb2ceaf29d78afd, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.476508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.477330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.477687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.478012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.478670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f745496-cb4b-4507-81cb-07c52b9e3c55 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.479153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.481721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.491686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1061/2106] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:18 2022] PUT /identity/v3/projects/4190799c9dfc40268923d447fb0fbd7a/users/c493b870c1174f49afb2ceaf29d78afd/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:18.509531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab4cf-a5e6-4501-9851-20d5261cfb51 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.509856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab4cf-a5e6-4501-9851-20d5261cfb51 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.510593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab4cf-a5e6-4501-9851-20d5261cfb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.522602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1046/2107] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:18 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:18.525969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.550019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4acab4cf-a5e6-4501-9851-20d5261cfb51 None None] MFA Rules not processed for user `c493b870c1174f49afb2ceaf29d78afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:18.551989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4acab4cf-a5e6-4501-9851-20d5261cfb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:18.605379 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3f8fd-0029-44a1-ac40-952fbd9d1459 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.611283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.612032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.612381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.612710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.613443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.615627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.637637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1047/2108] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:18 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:18.642271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.645899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1062/2109] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:18.654475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab4cf-a5e6-4501-9851-20d5261cfb51 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.658027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756f07e-6fb6-4627-a54e-958cb8dece4b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.662886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.663553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.663845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.664126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.664856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.666539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.677660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1048/2110] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:18.681882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.693956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785810-de45-4bc6-b8ef-bb338cb8f467 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.699410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.700558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.700997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.701443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] PATH_INFO: `/v3/projects/34477d2bbd084ff3b1bbb213378b2cfe/users/214f0e526c62472e9a71c177fce8d55a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.719290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34477d2bbd084ff3b1bbb213378b2cfe, user_id=214f0e526c62472e9a71c177fce8d55a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.719561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab4cf-a5e6-4501-9851-20d5261cfb51 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.722394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.723467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.724471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.724762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.725046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.735554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.737026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.739464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1049/2111] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:18 2022] PUT /identity/v3/projects/34477d2bbd084ff3b1bbb213378b2cfe/users/214f0e526c62472e9a71c177fce8d55a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:18.743425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.748919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1063/2112] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:18.787429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:18.796855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.798628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:18.814436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703f4f-d510-4472-afe7-12c3dadeb3ed service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.841355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26551ba-00bf-4040-82ae-423cbd638f7d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.847299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.847981 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.848830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.848830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.849314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.851228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.852465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:18.862326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1050/2113] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:18.863008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.864712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:18.874506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.875653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.875955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.876228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.878023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:18.878387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1338ed-24df-4cd9-a529-a461aaedac92 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.883979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.885051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.885372 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.885654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] PATH_INFO: `/v3/users/c2e257ae4e744dd8a0553b7c2abee529` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.887223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e257ae4e744dd8a0553b7c2abee529)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.890172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.941046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e257ae4e744dd8a0553b7c2abee529'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:18.943268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.944500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.948179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e257ae4e744dd8a0553b7c2abee529'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:18.949305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e257ae4e744dd8a0553b7c2abee529'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:18.953507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1064/2114] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:18.954289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:18.959114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e257ae4e744dd8a0553b7c2abee529'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:18.959861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f5366a71-18e2-49ac-a36b-3d71d4687363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e257ae4e744dd8a0553b7c2abee529'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:18.965884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6183-3281-40d8-9c86-ea238c1f10d0 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:18.971386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:18.972275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:18.972555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:18.972878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] PATH_INFO: `/v3/projects/34477d2bbd084ff3b1bbb213378b2cfe/users/214f0e526c62472e9a71c177fce8d55a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:18.976220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34477d2bbd084ff3b1bbb213378b2cfe, user_id=214f0e526c62472e9a71c177fce8d55a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:18.978937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:18.989710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1051/2115] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:18 2022] DELETE /identity/v3/users/c2e257ae4e744dd8a0553b7c2abee529 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:18.990767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1065/2116] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:18 2022] PUT /identity/v3/projects/34477d2bbd084ff3b1bbb213378b2cfe/users/214f0e526c62472e9a71c177fce8d55a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:19.004815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.005194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.005577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.043028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] MFA Rules not processed for user `214f0e526c62472e9a71c177fce8d55a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:19.044535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:19.153271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1052/2117] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:19.164703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:19.168130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:19.253316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8873-35cd-44d8-b592-70fd5cc1c214 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:19.324907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26f97c-eb0d-43b1-815c-5749a309edcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:19.325660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f97c-eb0d-43b1-815c-5749a309edcc service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.325982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f97c-eb0d-43b1-815c-5749a309edcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.326268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f97c-eb0d-43b1-815c-5749a309edcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.328104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7a26f97c-eb0d-43b1-815c-5749a309edcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:19.395214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:19.426336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f97c-eb0d-43b1-815c-5749a309edcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:19.428946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f97c-eb0d-43b1-815c-5749a309edcc service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:19.447321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1066/2118] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:19.451550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:19.453126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:19.517880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:19.566003 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d221-e599-4686-861f-5816e80b1f3c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:19.570782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:19.571646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.571947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.572214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] PATH_INFO: `/v3/projects/ae18a142aa2049ffa07fc6516203f6fe` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.573469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae18a142aa2049ffa07fc6516203f6fe)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:19.575609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:19.632169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae18a142aa2049ffa07fc6516203f6fe', 'request_id': 'req-3d334275-f44e-44fb-af2c-9837df3ca490'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:19.639345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae18a142aa2049ffa07fc6516203f6fe', 'request_id': 'req-3d334275-f44e-44fb-af2c-9837df3ca490'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:19.646000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae18a142aa2049ffa07fc6516203f6fe', 'request_id': 'req-3d334275-f44e-44fb-af2c-9837df3ca490'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:19.661360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] The token cache is being invalidate because project ae18a142aa2049ffa07fc6516203f6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:19.661886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:19.662528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d334275-f44e-44fb-af2c-9837df3ca490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:19.665842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1053/2119] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:19 2022] DELETE /identity/v3/projects/ae18a142aa2049ffa07fc6516203f6fe => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:19.669067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9a452-e5eb-408f-a4cd-4b37454b6105 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.669634 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9a452-e5eb-408f-a4cd-4b37454b6105 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.670236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9a452-e5eb-408f-a4cd-4b37454b6105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.690566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d8b9a452-e5eb-408f-a4cd-4b37454b6105 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:19.692286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d8b9a452-e5eb-408f-a4cd-4b37454b6105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:19.784120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1067/2120] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:19.792178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cbabf-fc64-4731-b55c-c44752717005 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.792478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cbabf-fc64-4731-b55c-c44752717005 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.792764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cbabf-fc64-4731-b55c-c44752717005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.816002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7b3cbabf-fc64-4731-b55c-c44752717005 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:19.817216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7b3cbabf-fc64-4731-b55c-c44752717005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:19.826360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1054/2121] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:19.831171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9a452-e5eb-408f-a4cd-4b37454b6105 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:19.840823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9a452-e5eb-408f-a4cd-4b37454b6105 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:19.846320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:19.847036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.847325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.847606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.848364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:19.848852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:19.850314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:19.868322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1068/2122] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:58:19.869603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3cbabf-fc64-4731-b55c-c44752717005 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:19.879273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3cbabf-fc64-4731-b55c-c44752717005 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:19.884431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:19.885194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.885553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.886269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.886707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:19.888775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:19.921362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1055/2123] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:19 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:19.922780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:19.932927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526306-b814-4319-9c3f-c66bb23a3d81 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:19.995464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:19.996137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:19.996427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:19.996710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:19.997413 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:19.999385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.018792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1069/2124] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:19 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:20.022990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.033966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e45a57-0ea0-4832-a536-52794a25c67e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.038753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.039378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.039711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.039989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.040706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.042343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.052474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1056/2125] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:20.056462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.066859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148c307-1218-43b4-b447-4f6ee292e427 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.071519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0dd39-1ea3-4335-a5d9-05271f36dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.072170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0dd39-1ea3-4335-a5d9-05271f36dbee admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.072461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0dd39-1ea3-4335-a5d9-05271f36dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.072745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0dd39-1ea3-4335-a5d9-05271f36dbee admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.073474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0dd39-1ea3-4335-a5d9-05271f36dbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.075104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0dd39-1ea3-4335-a5d9-05271f36dbee admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.085489 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1070/2126] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:20.089438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.103507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a4b7-73fb-4f8b-bab9-ecc1c442ad94 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.108896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.109593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.109922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.110201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] PATH_INFO: `/v3/projects/9b15ab2835134f2ea88cb76614bd7cc8/users/c14a0c3318a247b29a65098fd369da21/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.124625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b15ab2835134f2ea88cb76614bd7cc8, user_id=c14a0c3318a247b29a65098fd369da21, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.127913 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.140540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1057/2127] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:20 2022] PUT /identity/v3/projects/9b15ab2835134f2ea88cb76614bd7cc8/users/c14a0c3318a247b29a65098fd369da21/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:20.151757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7564f9-7bfb-4ef4-9c9a-beca817d16ed None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.152042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7564f9-7bfb-4ef4-9c9a-beca817d16ed None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.152343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7564f9-7bfb-4ef4-9c9a-beca817d16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.182429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ea7564f9-7bfb-4ef4-9c9a-beca817d16ed None None] MFA Rules not processed for user `c14a0c3318a247b29a65098fd369da21`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:20.183668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ea7564f9-7bfb-4ef4-9c9a-beca817d16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:20.224346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:20.251199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1071/2128] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:20.255793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.305803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:20.320848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad291-039e-4ef0-859f-b009dc5306cf admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.325865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.326781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.327068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.327352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.328038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.330600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.360799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1058/2129] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:20 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:20.361966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7564f9-7bfb-4ef4-9c9a-beca817d16ed None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.372519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7564f9-7bfb-4ef4-9c9a-beca817d16ed None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.432917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.433590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.433913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.434199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.434890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.436838 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.457702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1072/2130] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:20 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:20.461777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.472142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea6f74-4c05-49d4-a537-35e86501c831 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.476970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.477577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.477918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.478192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.478923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.480568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.492044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1059/2131] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:20.496018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.506880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb24d2-c15a-4638-a6ec-5d8073a9016b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.512565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.513452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.513943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.514228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] PATH_INFO: `/v3/projects/5e3d965ce85647abacb5f38b47e4108e/users/f0bbe144cd9841478a1eccb47263b582/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.530432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3d965ce85647abacb5f38b47e4108e, user_id=f0bbe144cd9841478a1eccb47263b582, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.533354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.548576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1073/2132] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:20 2022] PUT /identity/v3/projects/5e3d965ce85647abacb5f38b47e4108e/users/f0bbe144cd9841478a1eccb47263b582/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:20.551772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.561724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a8346-2999-4702-95e9-2af5e5b9b62a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.622172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12835449-88bd-489e-9ac8-2adf76da462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.622877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835449-88bd-489e-9ac8-2adf76da462f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.623152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835449-88bd-489e-9ac8-2adf76da462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.623494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835449-88bd-489e-9ac8-2adf76da462f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.624113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12835449-88bd-489e-9ac8-2adf76da462f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.626276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12835449-88bd-489e-9ac8-2adf76da462f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.641630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1060/2133] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:20.642775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.657824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d62e-aa31-435f-9d72-adb667c03f26 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.662740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.663631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.663918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.664338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] PATH_INFO: `/v3/projects/5e3d965ce85647abacb5f38b47e4108e/users/f0bbe144cd9841478a1eccb47263b582/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.667245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3d965ce85647abacb5f38b47e4108e, user_id=f0bbe144cd9841478a1eccb47263b582, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.669927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:20.682079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1074/2134] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:20 2022] PUT /identity/v3/projects/5e3d965ce85647abacb5f38b47e4108e/users/f0bbe144cd9841478a1eccb47263b582/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:20.693415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.693717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.694054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.720752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] MFA Rules not processed for user `f0bbe144cd9841478a1eccb47263b582`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:20.721980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:20.799785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1061/2135] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:20.842741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:20.846821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:20.920919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dcee1-9a6e-42b2-9eb9-3beab93abd92 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:20.924667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f2a76-ef14-49ec-ae88-e794953bee50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:20.925316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f2a76-ef14-49ec-ae88-e794953bee50 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:20.925602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f2a76-ef14-49ec-ae88-e794953bee50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:20.925910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f2a76-ef14-49ec-ae88-e794953bee50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:20.973991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:20.988348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f2a76-ef14-49ec-ae88-e794953bee50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:20.989828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f2a76-ef14-49ec-ae88-e794953bee50 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:21.001073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1075/2136] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:22.140342 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:22.142326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:22.204762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:22.221702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f7b9e-205f-4e7f-bde5-0e9cf612091f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:22.227701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:22.228532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:22.228860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:22.229245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] PATH_INFO: `/v3/users/1fc9449568974c5a8df1657ac30f284e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:22.230680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc9449568974c5a8df1657ac30f284e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:22.232734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:22.290134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc9449568974c5a8df1657ac30f284e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:22.298182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc9449568974c5a8df1657ac30f284e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:22.298902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc9449568974c5a8df1657ac30f284e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:22.313144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc9449568974c5a8df1657ac30f284e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:22.313910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc9449568974c5a8df1657ac30f284e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:22.340874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1062/2137] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:22 2022] DELETE /identity/v3/users/1fc9449568974c5a8df1657ac30f284e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:22.345506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:22.345978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:22.346156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:22.366924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:22.368128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:22.459914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1076/2138] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:22.470431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:22.472130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:22.534803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003bee-62a4-4b2f-b2b8-40d5bb30bb8d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:22.538935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:22.539796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:22.540135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:22.540439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:22.553185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:22.555485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:22.572562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1063/2139] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:22.915658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:22.917079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:22.931598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf40c47-e6e6-4930-9a44-04d4bd4f7cf5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:22.937160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:22.938790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:22.938915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:22.939155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] PATH_INFO: `/v3/projects/5ea89aad83784931bd36e16c29cbe523` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:22.940405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea89aad83784931bd36e16c29cbe523)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:22.942456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:22.989768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea89aad83784931bd36e16c29cbe523', 'request_id': 'req-e812091a-511a-487f-ae2d-71510678fe7b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:22.996175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea89aad83784931bd36e16c29cbe523', 'request_id': 'req-e812091a-511a-487f-ae2d-71510678fe7b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.004472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea89aad83784931bd36e16c29cbe523', 'request_id': 'req-e812091a-511a-487f-ae2d-71510678fe7b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.015722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] The token cache is being invalidate because project 5ea89aad83784931bd36e16c29cbe523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:23.016012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.016639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.018236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1077/2140] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:22 2022] DELETE /identity/v3/projects/5ea89aad83784931bd36e16c29cbe523 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:23.022195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.032458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de78009-ce2f-4c4d-8fc8-25653f492ac3 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.092543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:23.093341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.093634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.094630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] PATH_INFO: `/v3/users/214f0e526c62472e9a71c177fce8d55a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.095829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214f0e526c62472e9a71c177fce8d55a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:23.097774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:23.103149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:23.143031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214f0e526c62472e9a71c177fce8d55a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.149957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214f0e526c62472e9a71c177fce8d55a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.150614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214f0e526c62472e9a71c177fce8d55a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.158364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214f0e526c62472e9a71c177fce8d55a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.159009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214f0e526c62472e9a71c177fce8d55a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.176663 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1064/2141] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:23 2022] DELETE /identity/v3/users/214f0e526c62472e9a71c177fce8d55a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:23.302725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.304317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.317694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812091a-511a-487f-ae2d-71510678fe7b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.384298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:23.385824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.386117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.386396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] PATH_INFO: `/v3/users/b5c22ac0f98b466096b03cf99d983464` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.387921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c22ac0f98b466096b03cf99d983464)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:23.390197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:23.403990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:23.439690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c22ac0f98b466096b03cf99d983464'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.447116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c22ac0f98b466096b03cf99d983464'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.448815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c22ac0f98b466096b03cf99d983464'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.456809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c22ac0f98b466096b03cf99d983464'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.457620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b855cd79-82e7-4fd7-8abf-2e05bd518412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c22ac0f98b466096b03cf99d983464'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.463007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.465198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.481052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1078/2142] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:23 2022] DELETE /identity/v3/users/b5c22ac0f98b466096b03cf99d983464 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:23.486055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719f097-4083-48a6-ba8f-350d5e425ef8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.486243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.486486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.486836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.511254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:23.512456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.561850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:23.562800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.563715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.564062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] PATH_INFO: `/v3/projects/34477d2bbd084ff3b1bbb213378b2cfe` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.565246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34477d2bbd084ff3b1bbb213378b2cfe)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:23.567197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:23.581873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1079/2143] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:23.589272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.590873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.605921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168a1a-79f0-4e8a-915c-86e049accb45 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.618271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34477d2bbd084ff3b1bbb213378b2cfe', 'request_id': 'req-39985cb5-4d1a-4b7f-b172-c93ce3974552'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.624904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34477d2bbd084ff3b1bbb213378b2cfe', 'request_id': 'req-39985cb5-4d1a-4b7f-b172-c93ce3974552'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.631175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34477d2bbd084ff3b1bbb213378b2cfe', 'request_id': 'req-39985cb5-4d1a-4b7f-b172-c93ce3974552'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.643407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] The token cache is being invalidate because project 34477d2bbd084ff3b1bbb213378b2cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:23.643690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.644314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.645880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1065/2144] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:23 2022] DELETE /identity/v3/projects/34477d2bbd084ff3b1bbb213378b2cfe => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:23.649975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.651679 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.667564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:23.668746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.669290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.669487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] PATH_INFO: `/v3/users/87bcbe4b84124c6f9da6d3d14c19d8f6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.670437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:23.670713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bcbe4b84124c6f9da6d3d14c19d8f6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:23.673189 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:23.715286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39985cb5-4d1a-4b7f-b172-c93ce3974552 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.719752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44103f-ef58-4058-af7e-1d5154634453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:23.720386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44103f-ef58-4058-af7e-1d5154634453 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.720686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44103f-ef58-4058-af7e-1d5154634453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.720951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44103f-ef58-4058-af7e-1d5154634453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.721274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:23.723024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dc44103f-ef58-4058-af7e-1d5154634453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.735662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44103f-ef58-4058-af7e-1d5154634453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:23.735935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bcbe4b84124c6f9da6d3d14c19d8f6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.737142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44103f-ef58-4058-af7e-1d5154634453 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:23.744150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bcbe4b84124c6f9da6d3d14c19d8f6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.744906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bcbe4b84124c6f9da6d3d14c19d8f6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.746963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1066/2145] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:23.751707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0490-4f00-4281-8fa6-ad6e1c3b11ee None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.752002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0490-4f00-4281-8fa6-ad6e1c3b11ee None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.752294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0490-4f00-4281-8fa6-ad6e1c3b11ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.754942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bcbe4b84124c6f9da6d3d14c19d8f6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.755626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-dde3ea7a-8443-40d2-ae4b-4b8ba9a5d2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bcbe4b84124c6f9da6d3d14c19d8f6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:23.771740 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8dbe0490-4f00-4281-8fa6-ad6e1c3b11ee None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:23.773015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8dbe0490-4f00-4281-8fa6-ad6e1c3b11ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.777706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1080/2146] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:23 2022] DELETE /identity/v3/users/87bcbe4b84124c6f9da6d3d14c19d8f6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:23.782905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.783197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.783479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.786162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1067/2147] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:23.793812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe35a-d616-4de9-b069-fdc0a6c15ce6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.794110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe35a-d616-4de9-b069-fdc0a6c15ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.794392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe35a-d616-4de9-b069-fdc0a6c15ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.805779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:23.807443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.814475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c2dbe35a-d616-4de9-b069-fdc0a6c15ce6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:23.815799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c2dbe35a-d616-4de9-b069-fdc0a6c15ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.885412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1081/2148] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:23.891501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.893917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:23.898532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1068/2149] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:23.900880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbe35a-d616-4de9-b069-fdc0a6c15ce6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.912882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbe35a-d616-4de9-b069-fdc0a6c15ce6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.919057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:23.920096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.920624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.921154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.922142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:23.923385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:23.926091 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:23.941428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1069/2150] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:58:23.946386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:23.960699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfbd2-23f0-4934-84be-afdcfa8d0705 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.975093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:23.975779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:23.976066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:23.976514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:23.977042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:23.978985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:23.993990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47566-34ce-4d00-ae1b-3a2e2425e0ac None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:23.999913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.000802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.001323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.001709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.012537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.014329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.016315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1070/2151] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:23 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:24.020769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.030459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1082/2152] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:24.053917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.055649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.084600 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c12d7-20d7-4995-afa8-86e801daf800 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.123691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5085b3b-926c-433f-b2de-4dbda862a7e0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.128877 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.129689 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.130029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.130385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.131090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.133385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.151894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:24.160185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1071/2153] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:24 2022] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:24.165289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.166106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.167013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.167471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.167596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] PATH_INFO: `/v3/projects/ee933809ee5e4129b3d2b8712e3f008b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.169160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee933809ee5e4129b3d2b8712e3f008b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.171275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.177327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f829a1-b9e2-47ec-b82e-6ae058ad53ca admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.182321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.183250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.183250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.183590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.184411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.186053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.190154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:24.205552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1072/2154] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:24.210531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.235701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee933809ee5e4129b3d2b8712e3f008b', 'request_id': 'req-cb2086ea-eb11-466f-bf9a-6abac0073d22'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.237458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbde87-94a3-43b9-9d64-2b63cf95461e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.242019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee933809ee5e4129b3d2b8712e3f008b', 'request_id': 'req-cb2086ea-eb11-466f-bf9a-6abac0073d22'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.251414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee933809ee5e4129b3d2b8712e3f008b', 'request_id': 'req-cb2086ea-eb11-466f-bf9a-6abac0073d22'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.265543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] The token cache is being invalidate because project ee933809ee5e4129b3d2b8712e3f008b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:24.265920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.267124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.269109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1083/2155] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:24 2022] DELETE /identity/v3/projects/ee933809ee5e4129b3d2b8712e3f008b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:24.272881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.274798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.301829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.302520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.302871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.303181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.303887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.305520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.317789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1073/2156] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:24.320452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.322333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.339808 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a9fa3-19b2-4cd4-b3d5-79f4c732cf5e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.345979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.346875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.347169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.347585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] PATH_INFO: `/v3/projects/6adf0be3bda94e5f90356434f340305b/users/2a813ceb8f66432194e07aa62bebdd82/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.358722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2086ea-eb11-466f-bf9a-6abac0073d22 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.363687 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.364609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.365169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.365466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] PATH_INFO: `/v3/users/c14e14ec148c4c01bc8e055248cfe114` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.366871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14e14ec148c4c01bc8e055248cfe114)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.368801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.369274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adf0be3bda94e5f90356434f340305b, user_id=2a813ceb8f66432194e07aa62bebdd82, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.372249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.391577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1074/2157] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:24 2022] PUT /identity/v3/projects/6adf0be3bda94e5f90356434f340305b/users/2a813ceb8f66432194e07aa62bebdd82/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:24.401412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.403484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.430166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14e14ec148c4c01bc8e055248cfe114'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.438177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14e14ec148c4c01bc8e055248cfe114'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.438909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14e14ec148c4c01bc8e055248cfe114'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.446277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14e14ec148c4c01bc8e055248cfe114'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.447023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-01b9831f-56a7-435f-9fb1-c2a9b9a3aab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14e14ec148c4c01bc8e055248cfe114'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.465130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1084/2158] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:24 2022] DELETE /identity/v3/users/c14e14ec148c4c01bc8e055248cfe114 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:24.469912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.470216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.470503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.471797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5b3c-6c8b-45bf-b47a-2a4e425793ff admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.477137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:24.502268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] MFA Rules not processed for user `2a813ceb8f66432194e07aa62bebdd82`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:24.503510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.547797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.548674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.548966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.549247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] PATH_INFO: `/v3/projects/4dbc95b61a084dc8852991e13166a911` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.550482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbc95b61a084dc8852991e13166a911)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.552400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.571597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:24.587859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1085/2159] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:24.596234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.597695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.628288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbc95b61a084dc8852991e13166a911', 'request_id': 'req-e6b310d3-c26a-499d-96ae-01b7e66b72b3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.641917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbc95b61a084dc8852991e13166a911', 'request_id': 'req-e6b310d3-c26a-499d-96ae-01b7e66b72b3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.649690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbc95b61a084dc8852991e13166a911', 'request_id': 'req-e6b310d3-c26a-499d-96ae-01b7e66b72b3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.670290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358c984-6440-4c3e-9eaa-2f04a9bcabc0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.671333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] The token cache is being invalidate because project 4dbc95b61a084dc8852991e13166a911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:24.671546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.672209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.674110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1075/2160] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:24 2022] DELETE /identity/v3/projects/4dbc95b61a084dc8852991e13166a911 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:24.678041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.679401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.734470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.735228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.735520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.735801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.738861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.774193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b310d3-c26a-499d-96ae-01b7e66b72b3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.782395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.783292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.783573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.783918 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] PATH_INFO: `/v3/users/b33d32cb828b4ed69cc52844eaf921ed` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.785211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33d32cb828b4ed69cc52844eaf921ed)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.787116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.826124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.828010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.837914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1086/2161] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:24.838668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.839943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.843516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33d32cb828b4ed69cc52844eaf921ed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.848308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:24.851483 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33d32cb828b4ed69cc52844eaf921ed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.852263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33d32cb828b4ed69cc52844eaf921ed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.856615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb220-3786-4dba-a0b6-35da06befccc service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:24.860823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33d32cb828b4ed69cc52844eaf921ed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.861536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33d32cb828b4ed69cc52844eaf921ed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.863042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:24.864071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:24.864532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:24.864974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] PATH_INFO: `/v3/projects/04244410583341d08d2c7bcecb56671b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:24.866341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] RBAC: Authorizing `identity:delete_project(project_id=04244410583341d08d2c7bcecb56671b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:24.868416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:24.882457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1076/2162] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:24 2022] DELETE /identity/v3/users/b33d32cb828b4ed69cc52844eaf921ed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:24.923146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04244410583341d08d2c7bcecb56671b', 'request_id': 'req-606a2774-333a-4f0d-acf1-7536deb133de'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.930497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04244410583341d08d2c7bcecb56671b', 'request_id': 'req-606a2774-333a-4f0d-acf1-7536deb133de'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.940118 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04244410583341d08d2c7bcecb56671b', 'request_id': 'req-606a2774-333a-4f0d-acf1-7536deb133de'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.952060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] The token cache is being invalidate because project 04244410583341d08d2c7bcecb56671b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:24.952368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.953024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:24.955013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1087/2163] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:24 2022] DELETE /identity/v3/projects/04244410583341d08d2c7bcecb56671b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:24.958959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:24.960462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:24.994124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:25.039449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f961a-949b-4778-8068-904e07aa6e13 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:25.113650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:25.114614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.114907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.115188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] PATH_INFO: `/v3/users/c493b870c1174f49afb2ceaf29d78afd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.116614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c493b870c1174f49afb2ceaf29d78afd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:25.118615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:25.227443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c493b870c1174f49afb2ceaf29d78afd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.236771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c493b870c1174f49afb2ceaf29d78afd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.237451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c493b870c1174f49afb2ceaf29d78afd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.242260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:25.243877 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:25.250218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c493b870c1174f49afb2ceaf29d78afd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.251864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c493b870c1174f49afb2ceaf29d78afd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.267545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a2774-333a-4f0d-acf1-7536deb133de admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:25.276184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:25.277110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.277401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.277690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] PATH_INFO: `/v3/projects/d6422fba8fb840ac8512bb2f585a35e8` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.279320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6422fba8fb840ac8512bb2f585a35e8)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:25.282357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:25.289780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1077/2164] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:24 2022] DELETE /identity/v3/users/c493b870c1174f49afb2ceaf29d78afd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:25.346031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6422fba8fb840ac8512bb2f585a35e8', 'request_id': 'req-440e97b9-b2cf-48d2-b662-d9ea257da025'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.351716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6422fba8fb840ac8512bb2f585a35e8', 'request_id': 'req-440e97b9-b2cf-48d2-b662-d9ea257da025'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.361121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6422fba8fb840ac8512bb2f585a35e8', 'request_id': 'req-440e97b9-b2cf-48d2-b662-d9ea257da025'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.373191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] The token cache is being invalidate because project d6422fba8fb840ac8512bb2f585a35e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:25.373479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.374162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.381767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1088/2165] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:25 2022] DELETE /identity/v3/projects/d6422fba8fb840ac8512bb2f585a35e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:25.383284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:25.384924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:25.443029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:25.457882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cc5d-7e19-45eb-8662-f63ac0580c5e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:25.520750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:25.521928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.522244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.522523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] PATH_INFO: `/v3/users/e0223c90e74248f09c379ee14a959199` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.523856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0223c90e74248f09c379ee14a959199)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:25.525841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:25.576063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0223c90e74248f09c379ee14a959199'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.587067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0223c90e74248f09c379ee14a959199'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.587067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0223c90e74248f09c379ee14a959199'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.588664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:25.590035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:25.596242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0223c90e74248f09c379ee14a959199'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.596982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138e6241-d42f-4b3b-8096-610028d60b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0223c90e74248f09c379ee14a959199'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.615576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1078/2166] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:25 2022] DELETE /identity/v3/users/e0223c90e74248f09c379ee14a959199 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:25.626320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e97b9-b2cf-48d2-b662-d9ea257da025 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:25.695875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:25.695875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.695875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.695875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] PATH_INFO: `/v3/projects/4190799c9dfc40268923d447fb0fbd7a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.696287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4190799c9dfc40268923d447fb0fbd7a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:25.698119 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:25.709474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:25.750326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4190799c9dfc40268923d447fb0fbd7a', 'request_id': 'req-779607ff-1df4-4d9d-ad3e-68d3fa04973b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.757035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4190799c9dfc40268923d447fb0fbd7a', 'request_id': 'req-779607ff-1df4-4d9d-ad3e-68d3fa04973b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.765720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4190799c9dfc40268923d447fb0fbd7a', 'request_id': 'req-779607ff-1df4-4d9d-ad3e-68d3fa04973b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.778870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] The token cache is being invalidate because project 4190799c9dfc40268923d447fb0fbd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:25.779166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.779815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-779607ff-1df4-4d9d-ad3e-68d3fa04973b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:25.781710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1089/2167] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:25 2022] DELETE /identity/v3/projects/4190799c9dfc40268923d447fb0fbd7a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:25.788079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.788368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.788654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.809702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:25.810774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:25.874772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1079/2168] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:25.884987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4217f4-9828-477e-b902-efefd9d6a056 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.885282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4217f4-9828-477e-b902-efefd9d6a056 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.885564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4217f4-9828-477e-b902-efefd9d6a056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.906185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5e4217f4-9828-477e-b902-efefd9d6a056 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:25.908314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:25.908498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5e4217f4-9828-477e-b902-efefd9d6a056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:25.910225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:25.918778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1090/2169] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:25.923005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4217f4-9828-477e-b902-efefd9d6a056 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:25.932768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4217f4-9828-477e-b902-efefd9d6a056 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:25.937249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0d19-79dd-4b4d-ab46-c18b257afd91 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:25.937689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:25.938403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.938689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.938970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.939743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:25.940053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:25.941671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:25.950066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:25.951456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.951827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.952114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] PATH_INFO: `/v3/projects/0dde3120d6b544358f03d64f10e067f3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.953324 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dde3120d6b544358f03d64f10e067f3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:25.954581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1091/2170] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:58:25.955940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:25.958946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:25.967711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:25.968492 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933f4eb-675b-4850-8a56-f634581655c0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:25.973960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:25.974707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:25.975010 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:25.975357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:25.976038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:25.977946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.004902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1092/2171] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:25 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:26.006605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dde3120d6b544358f03d64f10e067f3', 'request_id': 'req-7caebd3c-f6ad-4598-acc3-3adc42f87370'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:26.013124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dde3120d6b544358f03d64f10e067f3', 'request_id': 'req-7caebd3c-f6ad-4598-acc3-3adc42f87370'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:26.014794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.019943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dde3120d6b544358f03d64f10e067f3', 'request_id': 'req-7caebd3c-f6ad-4598-acc3-3adc42f87370'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:26.035508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] The token cache is being invalidate because project 0dde3120d6b544358f03d64f10e067f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:26.036083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:26.040869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7caebd3c-f6ad-4598-acc3-3adc42f87370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:26.042563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1080/2172] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:25 2022] DELETE /identity/v3/projects/0dde3120d6b544358f03d64f10e067f3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:26.049453 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4b223-c78d-43aa-90a8-ff2c15477930 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.049868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4b223-c78d-43aa-90a8-ff2c15477930 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.050382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4b223-c78d-43aa-90a8-ff2c15477930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.069606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-57b4b223-c78d-43aa-90a8-ff2c15477930 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:26.070837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-57b4b223-c78d-43aa-90a8-ff2c15477930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:26.084735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979790aa-6052-45ff-8266-8dcdcf0a6795 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.089768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.090442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.090731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.091013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.091701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.093639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.114655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1093/2173] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:26.118783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.120366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:26.132376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c76c6-8f21-4861-b0cb-20532a3ba9b5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.133890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1081/2174] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:26.141491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.141697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589220f-4d7d-489a-97cc-c93dc2b38c31 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.142744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589220f-4d7d-489a-97cc-c93dc2b38c31 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.142862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.143262 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589220f-4d7d-489a-97cc-c93dc2b38c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.143551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.143707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.144353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.146057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.157785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1094/2175] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:26.161781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.164191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6589220f-4d7d-489a-97cc-c93dc2b38c31 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:26.165389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6589220f-4d7d-489a-97cc-c93dc2b38c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:26.171458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5615b3-69d0-40d2-819c-eb1f3ecc4bfa admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.173310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1082/2176] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:26.176092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.176736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.177026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.177265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589220f-4d7d-489a-97cc-c93dc2b38c31 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.177363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.178062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.179645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.186131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589220f-4d7d-489a-97cc-c93dc2b38c31 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.193996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1095/2177] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:26.194126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.194126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.194126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.194126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.194418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:26.194418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.194949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.195069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.205819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e492c3-1a3e-41c6-b7f8-d7662440f21d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.210763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1083/2178] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:58:26.212329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.214958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee7cb2-666f-45b4-b848-7b0bc7d1f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.215895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7cb2-666f-45b4-b848-7b0bc7d1f295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.216246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7cb2-666f-45b4-b848-7b0bc7d1f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.216592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7cb2-666f-45b4-b848-7b0bc7d1f295 admin admin] PATH_INFO: `/v3/projects/3e8079a682144a76a6bc78b27565d833/users/4eb13db6f3d940cfa1d83dcb09e65dd7/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.223454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3df9b-c06f-4b94-82c5-a9e0046b9d14 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.229097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.229741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.230277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.230577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.231329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.233374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7cb2-666f-45b4-b848-7b0bc7d1f295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8079a682144a76a6bc78b27565d833, user_id=4eb13db6f3d940cfa1d83dcb09e65dd7, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.233500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.236368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7cb2-666f-45b4-b848-7b0bc7d1f295 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.247184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:26.254569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1096/2179] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:26 2022] PUT /identity/v3/projects/3e8079a682144a76a6bc78b27565d833/users/4eb13db6f3d940cfa1d83dcb09e65dd7/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:26.267065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee461e-d041-4bc9-a581-eaa80c13df9b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.267376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee461e-d041-4bc9-a581-eaa80c13df9b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.267928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee461e-d041-4bc9-a581-eaa80c13df9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.273002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1084/2180] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:26.276820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.295269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2aee461e-d041-4bc9-a581-eaa80c13df9b None None] MFA Rules not processed for user `4eb13db6f3d940cfa1d83dcb09e65dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:26.296452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2aee461e-d041-4bc9-a581-eaa80c13df9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:26.339200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d03aa-d105-4eb6-9c16-22e9838bc456 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.344950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.345879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.346094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.346217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.346894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.348861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.356051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:26.372635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1097/2181] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:26.377228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1085/2182] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:26.378289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee461e-d041-4bc9-a581-eaa80c13df9b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.378433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.388358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e472b-d6fb-4a27-86a6-3f881d783fd0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.389377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee461e-d041-4bc9-a581-eaa80c13df9b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.396076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.396076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.396076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.396076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.396460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.397348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.398033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.399132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.399441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.399653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.400364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.402331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.415986 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1086/2183] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:26.419760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.432048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36bf58-c6cf-44cc-b36d-b006d764b06c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.437354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1098/2184] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:26.438537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.504917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.505693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.506078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.506429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.507249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.508929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.513439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67a5b-c774-462b-a7d6-2d9ee7d5fe25 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.518352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.519020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.519308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.519587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.520278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.521673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1087/2185] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:26.522232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.525790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.539991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5b88-cfde-44b1-88e0-c1117a31a929 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.545790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1099/2186] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:26.545923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.545923 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.546107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.546310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] PATH_INFO: `/v3/projects/d3c4a1843a98436c81df8111244795ac/users/7f67bf225f3a4ac5bcf07dde077101fd/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.548785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.558362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0b89-ac33-49ba-8f7c-11c127eedddd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.561539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c4a1843a98436c81df8111244795ac, user_id=7f67bf225f3a4ac5bcf07dde077101fd, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.563575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e20bb-96c1-4a9a-9681-215fde02c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.564220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e20bb-96c1-4a9a-9681-215fde02c1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.564503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e20bb-96c1-4a9a-9681-215fde02c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.564790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e20bb-96c1-4a9a-9681-215fde02c1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.564910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.565494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e20bb-96c1-4a9a-9681-215fde02c1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.567098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e20bb-96c1-4a9a-9681-215fde02c1c4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.578003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1100/2187] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:26.579451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1088/2188] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:26 2022] PUT /identity/v3/projects/d3c4a1843a98436c81df8111244795ac/users/7f67bf225f3a4ac5bcf07dde077101fd/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:26.584148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.584451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.584843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.585176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.602433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:26.603616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:26.649081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:26.649879 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26cdc6-22a6-482e-ac22-3dde0040753e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.656023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.657204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.657525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.657837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] PATH_INFO: `/v3/projects/f72679e650a24bb890280ddfeed68dbc/users/dd4c2e9b5e174b7ebe583998eec9a81a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.668966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1101/2189] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:26.675294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72679e650a24bb890280ddfeed68dbc, user_id=dd4c2e9b5e174b7ebe583998eec9a81a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.678136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.681495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.683322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:26.694244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1089/2190] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:26 2022] PUT /identity/v3/projects/f72679e650a24bb890280ddfeed68dbc/users/dd4c2e9b5e174b7ebe583998eec9a81a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:26.699700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.739461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:26.750496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f73b99-e041-48d8-9c78-876369e0d554 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.769279 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3c193-0b15-45b3-b502-bdeab13e4d2c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.774046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.774710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.774995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.775275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.775992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.777603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.789109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1090/2191] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:26.793110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.800678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25c111-5a47-4f94-9d51-081d6be53088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.801321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c111-5a47-4f94-9d51-081d6be53088 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.801608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c111-5a47-4f94-9d51-081d6be53088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.801923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c111-5a47-4f94-9d51-081d6be53088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.805092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9faac8-8be6-43ba-a893-8e794e72eb8d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:26.809921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:26.810915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.811225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.811346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25c111-5a47-4f94-9d51-081d6be53088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.811508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] PATH_INFO: `/v3/projects/f72679e650a24bb890280ddfeed68dbc/users/dd4c2e9b5e174b7ebe583998eec9a81a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.813404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25c111-5a47-4f94-9d51-081d6be53088 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.814683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72679e650a24bb890280ddfeed68dbc, user_id=dd4c2e9b5e174b7ebe583998eec9a81a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:26.817432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:26.823080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1102/2192] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:26.829353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1091/2193] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:26 2022] PUT /identity/v3/projects/f72679e650a24bb890280ddfeed68dbc/users/dd4c2e9b5e174b7ebe583998eec9a81a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:26.839403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56b95a-ac97-4c6f-8f7a-edac2d8292a2 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:26.839772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56b95a-ac97-4c6f-8f7a-edac2d8292a2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:26.840122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56b95a-ac97-4c6f-8f7a-edac2d8292a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:26.869575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1e56b95a-ac97-4c6f-8f7a-edac2d8292a2 None None] MFA Rules not processed for user `dd4c2e9b5e174b7ebe583998eec9a81a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:26.870821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1e56b95a-ac97-4c6f-8f7a-edac2d8292a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:26.946106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1103/2194] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:26.958309 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:26.960185 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:27.024604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063b01-4ec4-4ef2-9e18-c17b3bfbf1a4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:27.029255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:27.029255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:27.029486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:27.029869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:27.041233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:27.043315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:27.053898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1092/2195] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:27.839472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56b95a-ac97-4c6f-8f7a-edac2d8292a2 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:27.843949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:27.846900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:27.866256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec49b7-4fb3-4f24-8579-7a08fb89d720 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:27.870122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a53a7-50c9-4993-93df-ec100a7996e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:27.870784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a53a7-50c9-4993-93df-ec100a7996e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:27.871063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a53a7-50c9-4993-93df-ec100a7996e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:27.871712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a53a7-50c9-4993-93df-ec100a7996e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:27.873599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c13a53a7-50c9-4993-93df-ec100a7996e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:27.903994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:27.970517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56b95a-ac97-4c6f-8f7a-edac2d8292a2 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:27.975309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:27.976200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:27.976488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:27.976880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] PATH_INFO: `/v3/users/4eb13db6f3d940cfa1d83dcb09e65dd7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:27.978263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eb13db6f3d940cfa1d83dcb09e65dd7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:27.980349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:27.987510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a53a7-50c9-4993-93df-ec100a7996e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:27.991889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a53a7-50c9-4993-93df-ec100a7996e2 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:28.019353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1093/2196] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:28.042194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eb13db6f3d940cfa1d83dcb09e65dd7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.051459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eb13db6f3d940cfa1d83dcb09e65dd7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.052190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eb13db6f3d940cfa1d83dcb09e65dd7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.064628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eb13db6f3d940cfa1d83dcb09e65dd7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.065287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eb13db6f3d940cfa1d83dcb09e65dd7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.103981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1104/2197] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:27 2022] DELETE /identity/v3/users/4eb13db6f3d940cfa1d83dcb09e65dd7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:28.110255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:28.110593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:28.110889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:28.154826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:28.156148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:28.229532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:28.248710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1094/2198] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:28.260169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:28.262441 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:28.345078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02881c57-273d-4317-892f-f3f3d87b0f06 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:28.350725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:28.351475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:28.351836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:28.352011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:28.364647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:28.366597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:28.427569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1105/2199] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:28.833544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:28.835055 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:28.858466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6aee-3787-43ed-afe2-b57c46aa200c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:28.873616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:28.874700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:28.875042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:28.875865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] PATH_INFO: `/v3/projects/3e8079a682144a76a6bc78b27565d833` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:28.878640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8079a682144a76a6bc78b27565d833)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:28.880633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:28.952978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8079a682144a76a6bc78b27565d833', 'request_id': 'req-3e2a5929-0230-4599-82b5-c125c07223e4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.962852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8079a682144a76a6bc78b27565d833', 'request_id': 'req-3e2a5929-0230-4599-82b5-c125c07223e4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.970259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8079a682144a76a6bc78b27565d833', 'request_id': 'req-3e2a5929-0230-4599-82b5-c125c07223e4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.984311 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] The token cache is being invalidate because project 3e8079a682144a76a6bc78b27565d833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:28.984636 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.985421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:28.987880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1095/2200] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:28 2022] DELETE /identity/v3/projects/3e8079a682144a76a6bc78b27565d833 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:28.991576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:29.002487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d98c-7c1a-4dc2-b79e-1495e457f113 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:29.079047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:29.091157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:29.092763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:29.093324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:29.093614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] PATH_INFO: `/v3/users/dd4c2e9b5e174b7ebe583998eec9a81a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:29.095054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4c2e9b5e174b7ebe583998eec9a81a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:29.097003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:29.150957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4c2e9b5e174b7ebe583998eec9a81a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.166531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4c2e9b5e174b7ebe583998eec9a81a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.169161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4c2e9b5e174b7ebe583998eec9a81a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.180395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4c2e9b5e174b7ebe583998eec9a81a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.181197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5b62ebbc-2776-44d5-94a3-1afd33aca198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4c2e9b5e174b7ebe583998eec9a81a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.213144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1106/2201] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:28 2022] DELETE /identity/v3/users/dd4c2e9b5e174b7ebe583998eec9a81a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:29.606347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:29.607785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:29.621113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a5929-0230-4599-82b5-c125c07223e4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:29.697448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:29.698540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:29.702146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:29.702146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] PATH_INFO: `/v3/projects/f72679e650a24bb890280ddfeed68dbc` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:29.702146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72679e650a24bb890280ddfeed68dbc)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:29.712730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:29.824072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72679e650a24bb890280ddfeed68dbc', 'request_id': 'req-efb63fb5-6b2b-48b9-964f-0c4f0921b979'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.839816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72679e650a24bb890280ddfeed68dbc', 'request_id': 'req-efb63fb5-6b2b-48b9-964f-0c4f0921b979'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.851131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72679e650a24bb890280ddfeed68dbc', 'request_id': 'req-efb63fb5-6b2b-48b9-964f-0c4f0921b979'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.877259 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] The token cache is being invalidate because project f72679e650a24bb890280ddfeed68dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:29.877959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.878582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-efb63fb5-6b2b-48b9-964f-0c4f0921b979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:29.881696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1096/2202] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:29 2022] DELETE /identity/v3/projects/f72679e650a24bb890280ddfeed68dbc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:29.886503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fbe4e-eedf-402a-866b-faf4e09ef2fc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:29.886818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fbe4e-eedf-402a-866b-faf4e09ef2fc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:29.887125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fbe4e-eedf-402a-866b-faf4e09ef2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:29.918085 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c15fbe4e-eedf-402a-866b-faf4e09ef2fc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:29.930893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c15fbe4e-eedf-402a-866b-faf4e09ef2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:30.022902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1107/2203] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:30.032978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26761f8-ec60-476c-bbf1-c00cf8d44ee0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.033339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26761f8-ec60-476c-bbf1-c00cf8d44ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.033644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26761f8-ec60-476c-bbf1-c00cf8d44ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.055352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:30.090490 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a26761f8-ec60-476c-bbf1-c00cf8d44ee0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:30.091750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a26761f8-ec60-476c-bbf1-c00cf8d44ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:30.122770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1097/2204] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:30.127688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fbe4e-eedf-402a-866b-faf4e09ef2fc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.142994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fbe4e-eedf-402a-866b-faf4e09ef2fc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.149886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.150823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.151261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.151688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.152826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:30.153312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.155442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:30.176036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1108/2205] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:58:30.180188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26761f8-ec60-476c-bbf1-c00cf8d44ee0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.196584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26761f8-ec60-476c-bbf1-c00cf8d44ee0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.201976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.202595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.202878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.203215 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.204652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.206722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:30.262597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1098/2206] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:30 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:30.265061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.276491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea679063-e8b2-4f19-8ff7-1dcfc90aef94 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.342841 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.343444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.343735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.344045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.345266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.347298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:30.354471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:30.378419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1109/2207] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:30 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:30.380826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.396562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d09e-00f5-4a81-8bc4-dfe1af4499cb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.401705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.402416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.402707 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.402988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.404762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.405573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:30.422087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1099/2208] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:30.424604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.437297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90268987-6bc7-4720-9899-922d12f76c6f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.449674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f7a2-5bba-4b56-97d8-a2c43b51d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.450390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f7a2-5bba-4b56-97d8-a2c43b51d371 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.450865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f7a2-5bba-4b56-97d8-a2c43b51d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.450974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f7a2-5bba-4b56-97d8-a2c43b51d371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.451691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f7a2-5bba-4b56-97d8-a2c43b51d371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.453308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f7a2-5bba-4b56-97d8-a2c43b51d371 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:30.474804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1110/2209] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:30.482391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.495578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58660fa9-647c-4500-b2f3-114b1ef3bc76 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.500659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.502006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.502405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.502792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] PATH_INFO: `/v3/projects/78ad1c658d34468eafe35b3613f3a58c/users/5fb41dfb819c426bb4193b7569ba6b8d/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.520359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ad1c658d34468eafe35b3613f3a58c, user_id=5fb41dfb819c426bb4193b7569ba6b8d, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.524078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:30.556162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1100/2210] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:30 2022] PUT /identity/v3/projects/78ad1c658d34468eafe35b3613f3a58c/users/5fb41dfb819c426bb4193b7569ba6b8d/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:30.559232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6b1a-3929-47ac-a012-6e3f3318b315 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.559523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6b1a-3929-47ac-a012-6e3f3318b315 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.559826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6b1a-3929-47ac-a012-6e3f3318b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.630431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-674c6b1a-3929-47ac-a012-6e3f3318b315 None None] MFA Rules not processed for user `5fb41dfb819c426bb4193b7569ba6b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:30.631683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-674c6b1a-3929-47ac-a012-6e3f3318b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:30.713350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1111/2211] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:30.727181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.729281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:30.790217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13c423-f098-4450-9c85-975fd460602f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.794924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf88f4-e1cd-4492-91e6-2c852757726b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.795643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf88f4-e1cd-4492-91e6-2c852757726b service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.796095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf88f4-e1cd-4492-91e6-2c852757726b service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.796203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf88f4-e1cd-4492-91e6-2c852757726b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.805862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf88f4-e1cd-4492-91e6-2c852757726b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.807315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf88f4-e1cd-4492-91e6-2c852757726b service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:30.817448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1101/2212] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:30.838626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6b1a-3929-47ac-a012-6e3f3318b315 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:30.942555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6b1a-3929-47ac-a012-6e3f3318b315 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:30.947665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:30.948592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:30.948888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:30.949161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] PATH_INFO: `/v3/users/5fb41dfb819c426bb4193b7569ba6b8d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:30.950455 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb41dfb819c426bb4193b7569ba6b8d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:30.952624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:31.009814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb41dfb819c426bb4193b7569ba6b8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.021693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb41dfb819c426bb4193b7569ba6b8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.022456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb41dfb819c426bb4193b7569ba6b8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.031232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb41dfb819c426bb4193b7569ba6b8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.032939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb41dfb819c426bb4193b7569ba6b8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.039969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:31.059073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1112/2213] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:58:30 2022] DELETE /identity/v3/users/5fb41dfb819c426bb4193b7569ba6b8d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:31.060769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:31.061248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:31.061435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:31.090798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:31.092630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:31.173722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1102/2214] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:31.184876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:31.186804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:31.269307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c413c27-f315-4d82-8f53-466736114403 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:31.273566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322032c8-d3ce-4175-9da6-3842dd6dcfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:31.274453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322032c8-d3ce-4175-9da6-3842dd6dcfbf service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:31.274903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322032c8-d3ce-4175-9da6-3842dd6dcfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:31.275364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322032c8-d3ce-4175-9da6-3842dd6dcfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:31.287537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322032c8-d3ce-4175-9da6-3842dd6dcfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:31.289283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322032c8-d3ce-4175-9da6-3842dd6dcfbf service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:31.304653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1113/2215] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:31.710421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:31.712104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:31.730077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebc78-9782-4572-88a0-157e983b6cbb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:31.735801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:31.736738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:31.737042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:31.737300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] PATH_INFO: `/v3/projects/78ad1c658d34468eafe35b3613f3a58c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:31.738920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ad1c658d34468eafe35b3613f3a58c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:31.742095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:31.803903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:31.821295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ad1c658d34468eafe35b3613f3a58c', 'request_id': 'req-9aa15303-c98d-4f74-8b4c-f845814c0cdb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.828826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ad1c658d34468eafe35b3613f3a58c', 'request_id': 'req-9aa15303-c98d-4f74-8b4c-f845814c0cdb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.840059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ad1c658d34468eafe35b3613f3a58c', 'request_id': 'req-9aa15303-c98d-4f74-8b4c-f845814c0cdb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.868343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] The token cache is being invalidate because project 78ad1c658d34468eafe35b3613f3a58c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:58:31.868643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.869314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9aa15303-c98d-4f74-8b4c-f845814c0cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:58:31.871792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1103/2216] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:58:31 2022] DELETE /identity/v3/projects/78ad1c658d34468eafe35b3613f3a58c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:31.883125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb54c1-5b6a-42ff-826e-21b6b13ebf3b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:31.883371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb54c1-5b6a-42ff-826e-21b6b13ebf3b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:31.883659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb54c1-5b6a-42ff-826e-21b6b13ebf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:31.912367 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-47eb54c1-5b6a-42ff-826e-21b6b13ebf3b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:31.914243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-47eb54c1-5b6a-42ff-826e-21b6b13ebf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:32.008642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1114/2217] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:32.011929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e08748-38ca-4d27-b169-d36b18d8fecf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.012516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e08748-38ca-4d27-b169-d36b18d8fecf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.012681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e08748-38ca-4d27-b169-d36b18d8fecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.039175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-32e08748-38ca-4d27-b169-d36b18d8fecf None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:32.040405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-32e08748-38ca-4d27-b169-d36b18d8fecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:32.055262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb54c1-5b6a-42ff-826e-21b6b13ebf3b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.055812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1104/2218] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:32.066586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb54c1-5b6a-42ff-826e-21b6b13ebf3b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.072246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72853a33-5ac8-42f4-92ff-cf2f18b287cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.073801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853a33-5ac8-42f4-92ff-cf2f18b287cf admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.073801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853a33-5ac8-42f4-92ff-cf2f18b287cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.074001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853a33-5ac8-42f4-92ff-cf2f18b287cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.074610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72853a33-5ac8-42f4-92ff-cf2f18b287cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:58:32.074922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72853a33-5ac8-42f4-92ff-cf2f18b287cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.076556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72853a33-5ac8-42f4-92ff-cf2f18b287cf admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.094015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1115/2219] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:58:32.095266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e08748-38ca-4d27-b169-d36b18d8fecf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.106289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e08748-38ca-4d27-b169-d36b18d8fecf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.111906 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.112569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.113053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.113553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.114619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.116731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.142316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.143017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.143330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.176244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1105/2220] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:32 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:32.177564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.180006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] MFA Rules not processed for user `7f67bf225f3a4ac5bcf07dde077101fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:32.181338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:32.267341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeee675-d6c6-4d8a-916b-6cb3e67be08b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.274098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.274781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.275322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.275322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.276034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.278338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.293165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1116/2221] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:32.294646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.296558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:32.324425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707c806-b4c6-4010-9b3a-2dc210a2b33c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.331227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1106/2222] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:32 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:32.334029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.337804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.338493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.339292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.339596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.340287 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.342504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.347012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:32.358019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858573a-47d4-451c-9ea3-5f32b6161d7f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.374045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.374827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.375121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.376198 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.376777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.378397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.382628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1117/2223] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:32 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:32.386059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.410493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1107/2224] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:32.414802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.426702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5682b4e-ef30-4c4a-90f5-ff93e470fe30 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.486652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc1d85-9ce1-46a4-9c0c-eb4df51d8f4d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.493164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.494405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.494405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.494587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.495305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.497339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.523121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1118/2225] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:32 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:32.526554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.529522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.530431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.530764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.531115 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.532209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.533908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.540196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c03525-d030-44be-8352-a049b4562f8d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.544956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.545435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1108/2226] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:32.545962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.546252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.546536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.547303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.548903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.549410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.559332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa002e2-a1ff-418f-946b-eb600486d940 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.562581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1119/2227] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:32.564074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.567628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02765b11-706b-41b5-beeb-3adfdeead675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.568695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02765b11-706b-41b5-beeb-3adfdeead675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.568983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02765b11-706b-41b5-beeb-3adfdeead675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.569281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02765b11-706b-41b5-beeb-3adfdeead675 admin admin] PATH_INFO: `/v3/projects/8a878ecfb9cd47b684c027beb6ad0b03/users/397ff11fedcc4d17867e1d9c10fcd10f/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.574986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f89a-0315-4e59-81c5-e29dc6591157 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.580886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.581991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.582404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.582963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] PATH_INFO: `/v3/projects/dfbcd684e221425787338add92f823b6/users/c6e16c8606024a6a8e0239b6694179c7/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.584248 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:32.588940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02765b11-706b-41b5-beeb-3adfdeead675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a878ecfb9cd47b684c027beb6ad0b03, user_id=397ff11fedcc4d17867e1d9c10fcd10f, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.593028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02765b11-706b-41b5-beeb-3adfdeead675 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.610388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1109/2228] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:32 2022] PUT /identity/v3/projects/8a878ecfb9cd47b684c027beb6ad0b03/users/397ff11fedcc4d17867e1d9c10fcd10f/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:32.615630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.615766 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbcd684e221425787338add92f823b6, user_id=c6e16c8606024a6a8e0239b6694179c7, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.616054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.616406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.618527 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.632478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1120/2229] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:32 2022] PUT /identity/v3/projects/dfbcd684e221425787338add92f823b6/users/c6e16c8606024a6a8e0239b6694179c7/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:32.635034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:32.636231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:32.636352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.704942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb2601-2177-4dcb-9ce3-c1be768b3fa9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.705176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1110/2230] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:58:32.715128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.716095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.716654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:32.717439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.717826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.718178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.719036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.720927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.741529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1121/2231] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:32.745349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:32.757789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d406e-bb56-4924-8f1e-08c2d6338d43 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.762664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870204f8-5742-4dad-840f-9f21e33a18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.763543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870204f8-5742-4dad-840f-9f21e33a18f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.763829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870204f8-5742-4dad-840f-9f21e33a18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.764106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870204f8-5742-4dad-840f-9f21e33a18f0 admin admin] PATH_INFO: `/v3/projects/dfbcd684e221425787338add92f823b6/users/c6e16c8606024a6a8e0239b6694179c7/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.766807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870204f8-5742-4dad-840f-9f21e33a18f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbcd684e221425787338add92f823b6, user_id=c6e16c8606024a6a8e0239b6694179c7, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.769451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870204f8-5742-4dad-840f-9f21e33a18f0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.775292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da801f-1f7a-465a-b64e-15d917576a52 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:32.779882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1122/2232] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:32 2022] PUT /identity/v3/projects/dfbcd684e221425787338add92f823b6/users/c6e16c8606024a6a8e0239b6694179c7/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:58:32.827375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:32.828136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:32.828328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:32.828619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:32.897978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:32.899489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:32.903728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:32.911965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1111/2233] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:39.619115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2693df-2118-4d12-8aad-badd0e2383e5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:39.619684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2693df-2118-4d12-8aad-badd0e2383e5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:39.619684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2693df-2118-4d12-8aad-badd0e2383e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:39.734161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2c2693df-2118-4d12-8aad-badd0e2383e5 None None] MFA Rules not processed for user `c6e16c8606024a6a8e0239b6694179c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:39.736249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2c2693df-2118-4d12-8aad-badd0e2383e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:39.770523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:40.021445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1123/2234] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:40.037177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:40.038756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:40.198884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288d839-6512-49d9-8e4c-5a72e0301e8d service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:40.205370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:40.214420 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:40.214830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:40.215233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:40.316996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:40.319516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:40.332764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113456c-f867-443e-a180-ea9735965afd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:40.332887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113456c-f867-443e-a180-ea9735965afd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:40.333093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113456c-f867-443e-a180-ea9735965afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:40.333702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1112/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:58:40.420252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7113456c-f867-443e-a180-ea9735965afd None None] MFA Rules not processed for user `397ff11fedcc4d17867e1d9c10fcd10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:40.421583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7113456c-f867-443e-a180-ea9735965afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:40.560966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1124/2236] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:40.567935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:40.575341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:40.575692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:40.575985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:40.589830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabedfd2-db58-4b09-b539-95b9ed71b03d service glance] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:40.603664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:40.604450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:40.604816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:40.605202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:40.606443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:40.610581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:40.632951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:40.634995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:40.682725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1113/2237] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:58:40 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:58:40.695158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:40.755906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1125/2238] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:40.816790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee73da-cdf9-481e-9fd5-edc2a50d6c86 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:40.832702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:40.833951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:40.843345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:40.844889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:40.846312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:40.850336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:40.891547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:40.893008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:40.907046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1114/2239] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:58:40 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:58:40.910606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:40.955341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4b67d-b737-427b-9cb7-3712c575dbf1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:40.968192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:40.969424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:40.969713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:40.970018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:40.970763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:40.979062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:41.009333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1115/2240] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:58:41.011118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:41.025675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b628-e1a4-48ac-8423-0d2087c95613 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:41.029693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:41.038304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:41.040188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:41.040327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:41.040695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] PATH_INFO: `/v3/projects/27cf9487b969471b9cb35cecf7e9e462/users/b96eb76f136b4ff8902df06e134efb12/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:41.051416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:41.071514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cf9487b969471b9cb35cecf7e9e462, user_id=b96eb76f136b4ff8902df06e134efb12, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:41.075060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:41.096962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28ea25-42dd-47c1-8f11-ab7c6dfea5f4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:41.097779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1116/2241] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:41 2022] PUT /identity/v3/projects/27cf9487b969471b9cb35cecf7e9e462/users/b96eb76f136b4ff8902df06e134efb12/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:41.098756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:41.181795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a476-18eb-40f9-b230-2748fb955f60 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:41.188523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:41.189779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:41.189779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:41.189779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:41.190972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:41.192865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:41.213980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1117/2242] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:58:41.219122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:41.238407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c982612-3eb9-4ad1-b537-9d979f40fc71 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:41.242568 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:41.243798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:41.243930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb2601-f27f-4d74-a544-7a9ffaabceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:41.244452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:41.244814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb2601-f27f-4d74-a544-7a9ffaabceb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:41.245196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:41.245398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb2601-f27f-4d74-a544-7a9ffaabceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:41.245669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb2601-f27f-4d74-a544-7a9ffaabceb6 admin admin] PATH_INFO: `/v3/projects/27cf9487b969471b9cb35cecf7e9e462/users/b96eb76f136b4ff8902df06e134efb12/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:41.247997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb2601-f27f-4d74-a544-7a9ffaabceb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cf9487b969471b9cb35cecf7e9e462, user_id=b96eb76f136b4ff8902df06e134efb12, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:41.250741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb2601-f27f-4d74-a544-7a9ffaabceb6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:41.263826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1118/2243] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:58:41 2022] PUT /identity/v3/projects/27cf9487b969471b9cb35cecf7e9e462/users/b96eb76f136b4ff8902df06e134efb12/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:58:41.318030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:41.319664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:41.329558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1126/2244] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 09:58:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 09:58:51.064722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e516d-bfc0-469b-b010-2614e64cfc03 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:51.065261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e516d-bfc0-469b-b010-2614e64cfc03 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:51.065369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e516d-bfc0-469b-b010-2614e64cfc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:51.154299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-286e516d-bfc0-469b-b010-2614e64cfc03 None None] MFA Rules not processed for user `b96eb76f136b4ff8902df06e134efb12`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:51.155731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-286e516d-bfc0-469b-b010-2614e64cfc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:51.316161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1119/2245] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:58:51.330909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=61 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:51.341460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:58:51.343085 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:51.507336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841402-7d9b-4223-bae1-452072a8fc51 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:58:51.630792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7cc6b-633c-48c4-9e22-495b91b9df14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:58:51.631760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7cc6b-633c-48c4-9e22-495b91b9df14 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:51.632199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7cc6b-633c-48c4-9e22-495b91b9df14 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:51.632632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7cc6b-633c-48c4-9e22-495b91b9df14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:51.720774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7cc6b-633c-48c4-9e22-495b91b9df14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:58:51.722502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7cc6b-633c-48c4-9e22-495b91b9df14 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:58:51.733524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1127/2246] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:58:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:58:58.707594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d7ac-648e-4a2e-8656-c244884a67df None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:58:58.708142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d7ac-648e-4a2e-8656-c244884a67df None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:58:58.708142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d7ac-648e-4a2e-8656-c244884a67df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:58:58.735544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8d48d7ac-648e-4a2e-8656-c244884a67df None None] MFA Rules not processed for user `7f67bf225f3a4ac5bcf07dde077101fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:58:58.736775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8d48d7ac-648e-4a2e-8656-c244884a67df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:58:58.777956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:58.814099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1120/2247] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:01.461080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:01.461638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:01.461638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:01.480416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:01.482022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:01.519081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:01.565213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1128/2248] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:01.578917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48d7ac-648e-4a2e-8656-c244884a67df None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:01.672974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48d7ac-648e-4a2e-8656-c244884a67df None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:01.679886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de98167-4ff3-457e-a0d6-95c5f77a2271 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:01.680687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de98167-4ff3-457e-a0d6-95c5f77a2271 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:01.680979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de98167-4ff3-457e-a0d6-95c5f77a2271 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:01.681291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de98167-4ff3-457e-a0d6-95c5f77a2271 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:01.692930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de98167-4ff3-457e-a0d6-95c5f77a2271 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:01.694613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de98167-4ff3-457e-a0d6-95c5f77a2271 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:01.722814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1121/2249] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 09:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:59:03.190521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:03.191960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:03.307269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c118-f61c-42bc-9d8d-23be7688e8d6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:03.311913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:03.313349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:03.313639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:03.313962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] PATH_INFO: `/v3/users/c14a0c3318a247b29a65098fd369da21` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:03.315168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14a0c3318a247b29a65098fd369da21)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:03.317110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:03.367551 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14a0c3318a247b29a65098fd369da21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:03.374990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14a0c3318a247b29a65098fd369da21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:03.376506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14a0c3318a247b29a65098fd369da21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:03.389294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14a0c3318a247b29a65098fd369da21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:03.390028 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14a0c3318a247b29a65098fd369da21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:03.413080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1129/2250] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:59:03 2022] DELETE /identity/v3/users/c14a0c3318a247b29a65098fd369da21 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:03.417561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:03.418541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:03.419089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:03.448131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:03.449363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:03.510847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1122/2251] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:03.523004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:03.524902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:03.546918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:03.612002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b9472-dc17-4b44-bf92-eea7ff707264 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:03.615977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:03.616640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:03.616949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:03.617214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:03.627664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:03.629113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:03.638617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1130/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:03.948404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:03.950116 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:03.963597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69148be8-58f8-4bb3-a11d-11172b8c5dff None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:03.971194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:03.972173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:03.972586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:03.972777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] PATH_INFO: `/v3/projects/9b15ab2835134f2ea88cb76614bd7cc8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:03.974013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b15ab2835134f2ea88cb76614bd7cc8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:03.976150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:04.042633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:04.058765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b15ab2835134f2ea88cb76614bd7cc8', 'request_id': 'req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.067315 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b15ab2835134f2ea88cb76614bd7cc8', 'request_id': 'req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.073871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b15ab2835134f2ea88cb76614bd7cc8', 'request_id': 'req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.097355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] The token cache is being invalidate because project 9b15ab2835134f2ea88cb76614bd7cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:59:04.097765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.098595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.103257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1123/2253] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:59:03 2022] DELETE /identity/v3/projects/9b15ab2835134f2ea88cb76614bd7cc8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:04.109003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:04.135633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b0d6-0607-4d28-80bd-56238c96e628 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:04.205819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:04.206718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:04.207009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:04.207291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] PATH_INFO: `/v3/users/f0bbe144cd9841478a1eccb47263b582` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:04.208578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bbe144cd9841478a1eccb47263b582)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:04.210576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:04.285394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bbe144cd9841478a1eccb47263b582'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.292853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bbe144cd9841478a1eccb47263b582'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.293684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bbe144cd9841478a1eccb47263b582'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.304314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bbe144cd9841478a1eccb47263b582'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.305179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7c349fbe-42a1-4e55-b2f0-1eed759f2236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bbe144cd9841478a1eccb47263b582'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.341258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1131/2254] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:59:04 2022] DELETE /identity/v3/users/f0bbe144cd9841478a1eccb47263b582 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:04.678866 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:04.680635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:04.707910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3a186-4cfb-4f18-a5d6-2e815ad0f14a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:04.768601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:04.769477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:04.769854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:04.770162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] PATH_INFO: `/v3/projects/5e3d965ce85647abacb5f38b47e4108e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:04.771368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3d965ce85647abacb5f38b47e4108e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:04.773654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:04.824554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3d965ce85647abacb5f38b47e4108e', 'request_id': 'req-a59b9380-4c66-4394-85dd-afc18c7cb304'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.832274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3d965ce85647abacb5f38b47e4108e', 'request_id': 'req-a59b9380-4c66-4394-85dd-afc18c7cb304'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.838195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3d965ce85647abacb5f38b47e4108e', 'request_id': 'req-a59b9380-4c66-4394-85dd-afc18c7cb304'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.851430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] The token cache is being invalidate because project 5e3d965ce85647abacb5f38b47e4108e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:59:04.851717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.852339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a59b9380-4c66-4394-85dd-afc18c7cb304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:04.853920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1124/2255] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:59:04 2022] DELETE /identity/v3/projects/5e3d965ce85647abacb5f38b47e4108e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:04.858979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc634d9-1df0-46ca-ae06-7f62d5a7b683 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:04.859822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc634d9-1df0-46ca-ae06-7f62d5a7b683 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:04.860115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc634d9-1df0-46ca-ae06-7f62d5a7b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:04.891968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:04.903579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-adc634d9-1df0-46ca-ae06-7f62d5a7b683 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:04.904996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-adc634d9-1df0-46ca-ae06-7f62d5a7b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:04.973817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1132/2256] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:04.980442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d8c4-b8f0-4cca-9857-f6ba6ed31962 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:04.980686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d8c4-b8f0-4cca-9857-f6ba6ed31962 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:04.981027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d8c4-b8f0-4cca-9857-f6ba6ed31962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.001774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d5c7d8c4-b8f0-4cca-9857-f6ba6ed31962 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:05.003035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d5c7d8c4-b8f0-4cca-9857-f6ba6ed31962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:05.011668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1125/2257] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:05.016576 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc634d9-1df0-46ca-ae06-7f62d5a7b683 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.033379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc634d9-1df0-46ca-ae06-7f62d5a7b683 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.037722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.038524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.039053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.039365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.040265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:59:05.040570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.042547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.060711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1133/2258] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:59:05.061898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d8c4-b8f0-4cca-9857-f6ba6ed31962 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.071972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d8c4-b8f0-4cca-9857-f6ba6ed31962 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.077341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.078176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.078463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.078852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.079565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.081521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.115825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1126/2259] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:59:05 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:05.120197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.140934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9551-e8ac-45c9-8438-9a9c97702a97 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.199243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.200018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.200376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.200746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.201487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.204412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.224577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1134/2260] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:59:05 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:05.228814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.239650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fc5d-bd58-4089-95c9-118e9ac171c4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.244940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.245606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.246018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.246353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.247238 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.249189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.260912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1127/2261] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:59:05.265200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.277092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720bd62-e7a5-4bc3-99e1-1f42472d4395 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.282148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815f59a-3ab0-42d5-b851-efe5a1139279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.282818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815f59a-3ab0-42d5-b851-efe5a1139279 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.283139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815f59a-3ab0-42d5-b851-efe5a1139279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.283429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815f59a-3ab0-42d5-b851-efe5a1139279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.284315 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815f59a-3ab0-42d5-b851-efe5a1139279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.285967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815f59a-3ab0-42d5-b851-efe5a1139279 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.297432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1135/2262] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:59:05.301629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.311641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57647fa2-4f08-4f7e-babe-166e36a9f2f2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.317658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.318782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.319077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.319364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] PATH_INFO: `/v3/projects/64464f33be974524bd7c1fd11054e5be/users/32d8a466525c478582e1c4b15fcfc470/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.338264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64464f33be974524bd7c1fd11054e5be, user_id=32d8a466525c478582e1c4b15fcfc470, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.341430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.350398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:05.357122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1128/2263] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:59:05 2022] PUT /identity/v3/projects/64464f33be974524bd7c1fd11054e5be/users/32d8a466525c478582e1c4b15fcfc470/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:05.367479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d59e3-6ec1-4ead-b1c4-0afabe82e74e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.367850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d59e3-6ec1-4ead-b1c4-0afabe82e74e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.368211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d59e3-6ec1-4ead-b1c4-0afabe82e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.400324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6e6d59e3-6ec1-4ead-b1c4-0afabe82e74e None None] MFA Rules not processed for user `32d8a466525c478582e1c4b15fcfc470`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:05.401422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6e6d59e3-6ec1-4ead-b1c4-0afabe82e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:05.486924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:05.493981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1136/2264] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:05.498804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.621038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac3d3-28ef-40a3-8d1a-209c95b8f256 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.626741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.627411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.627701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.628010 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.628710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.630703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.659774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1129/2265] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:59:05 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:05.663948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d59e3-6ec1-4ead-b1c4-0afabe82e74e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.676259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d59e3-6ec1-4ead-b1c4-0afabe82e74e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.741733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.742398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.742693 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.742976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.743684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.745629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.769588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1137/2266] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:59:05 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:05.774475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.786206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb82c8-9cec-46b6-9172-f199f05e6825 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.790902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.791572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.791854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.792146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.792853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.794492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.810011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1130/2267] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:59:05.811374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.822311 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590d3f-8eb3-4037-9c1d-faabc7aa5ff8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.827084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.828017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.828310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.828589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] PATH_INFO: `/v3/projects/5f6a3975917a45a6936615d3c25a61b8/users/33f7b6675eea4fb3a9a49b53ff2928f4/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.848758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6a3975917a45a6936615d3c25a61b8, user_id=33f7b6675eea4fb3a9a49b53ff2928f4, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.851538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.866917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1138/2268] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:59:05 2022] PUT /identity/v3/projects/5f6a3975917a45a6936615d3c25a61b8/users/33f7b6675eea4fb3a9a49b53ff2928f4/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:59:05.870802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.882000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a2103-cda0-42a6-8fc5-876b9168cee0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.959426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f9e0c-f2dd-4098-a04f-b23ee67ca55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:05.960109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9e0c-f2dd-4098-a04f-b23ee67ca55f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:05.960395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9e0c-f2dd-4098-a04f-b23ee67ca55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:05.960752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9e0c-f2dd-4098-a04f-b23ee67ca55f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:05.961499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9e0c-f2dd-4098-a04f-b23ee67ca55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:05.963153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9e0c-f2dd-4098-a04f-b23ee67ca55f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:05.977057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1131/2269] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:59:05.979179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:05.991283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6827d-b3b1-4165-8ede-adf081f3da6b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:05.998797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:06.007830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:06.008153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:06.008552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] PATH_INFO: `/v3/projects/5f6a3975917a45a6936615d3c25a61b8/users/33f7b6675eea4fb3a9a49b53ff2928f4/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:06.010756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6a3975917a45a6936615d3c25a61b8, user_id=33f7b6675eea4fb3a9a49b53ff2928f4, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:06.013415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:06.024805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1139/2270] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:59:05 2022] PUT /identity/v3/projects/5f6a3975917a45a6936615d3c25a61b8/users/33f7b6675eea4fb3a9a49b53ff2928f4/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:06.037095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f620-1453-4c1f-a179-887da3f2476c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:06.037435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f620-1453-4c1f-a179-887da3f2476c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:06.037725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f620-1453-4c1f-a179-887da3f2476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:06.068377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-15b0f620-1453-4c1f-a179-887da3f2476c None None] MFA Rules not processed for user `33f7b6675eea4fb3a9a49b53ff2928f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:06.069617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-15b0f620-1453-4c1f-a179-887da3f2476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:06.141798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:06.158394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1132/2271] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:06.170200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:06.172553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:06.240942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3007cd4-71de-4611-aa55-c8ed7f9aa917 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:06.246131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:06.247040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:06.249863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:06.249863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:06.263582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:06.265033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:06.276465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1140/2272] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:06.336090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f620-1453-4c1f-a179-887da3f2476c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:06.350448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f620-1453-4c1f-a179-887da3f2476c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:06.358175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aee70-bf91-41f5-bf2b-81dde827eb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:06.358868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aee70-bf91-41f5-bf2b-81dde827eb38 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:06.359210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aee70-bf91-41f5-bf2b-81dde827eb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:06.359519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aee70-bf91-41f5-bf2b-81dde827eb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:06.444307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65aee70-bf91-41f5-bf2b-81dde827eb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:06.446451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65aee70-bf91-41f5-bf2b-81dde827eb38 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:06.459960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1133/2273] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:16.271406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:16.389504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:16.452529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=31 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:16.465881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4845-62c4-468e-8d5c-46a283ad7959 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:16.471911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:16.472817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:16.473105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:16.473389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] PATH_INFO: `/v3/users/32d8a466525c478582e1c4b15fcfc470` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:16.474682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d8a466525c478582e1c4b15fcfc470)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:16.476623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:16.530480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d8a466525c478582e1c4b15fcfc470'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:16.537991 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d8a466525c478582e1c4b15fcfc470'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:16.538985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d8a466525c478582e1c4b15fcfc470'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:16.548981 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d8a466525c478582e1c4b15fcfc470'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:16.551863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d8a466525c478582e1c4b15fcfc470'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:16.582233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1141/2274] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:59:16 2022] DELETE /identity/v3/users/32d8a466525c478582e1c4b15fcfc470 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:59:16.585286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:16.585608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:16.585926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:16.604092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:16.605300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:16.678286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1134/2275] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:16.690304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:16.691726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:16.754859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910052b9-7694-4832-b436-f8715f150244 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:16.758463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:16.759113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:16.759399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:16.759677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:16.769507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:16.771027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:16.781246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1142/2276] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:17.075391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:17.076844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:17.092569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36e032-b9d8-4935-9054-a6bf3366c1d4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:17.102769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:17.103770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:17.104066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:17.104348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] PATH_INFO: `/v3/projects/64464f33be974524bd7c1fd11054e5be` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:17.106657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64464f33be974524bd7c1fd11054e5be)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:17.108137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:17.163436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64464f33be974524bd7c1fd11054e5be', 'request_id': 'req-9080cc82-2962-40b0-9098-b84daea0bad6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.170360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64464f33be974524bd7c1fd11054e5be', 'request_id': 'req-9080cc82-2962-40b0-9098-b84daea0bad6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.176686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64464f33be974524bd7c1fd11054e5be', 'request_id': 'req-9080cc82-2962-40b0-9098-b84daea0bad6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.190283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] The token cache is being invalidate because project 64464f33be974524bd7c1fd11054e5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:59:17.190570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.191245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.192980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1135/2277] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:59:17 2022] DELETE /identity/v3/projects/64464f33be974524bd7c1fd11054e5be => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:17.197195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:17.207210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7b16a-50a1-457b-959b-83aeedb6763b service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:17.227777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:17.273204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:17.274113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:17.274401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:17.274676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] PATH_INFO: `/v3/users/33f7b6675eea4fb3a9a49b53ff2928f4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:17.275895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f7b6675eea4fb3a9a49b53ff2928f4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:17.277872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:17.326246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f7b6675eea4fb3a9a49b53ff2928f4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.333078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f7b6675eea4fb3a9a49b53ff2928f4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.333731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f7b6675eea4fb3a9a49b53ff2928f4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.341024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f7b6675eea4fb3a9a49b53ff2928f4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.341627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e466d636-f010-4cbc-b88a-c7d22b7fdce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f7b6675eea4fb3a9a49b53ff2928f4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.359702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1143/2278] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:59:17 2022] DELETE /identity/v3/users/33f7b6675eea4fb3a9a49b53ff2928f4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:17.643171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:17.644659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:17.668015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080cc82-2962-40b0-9098-b84daea0bad6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:17.727994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:17.728780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:17.729068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:17.729345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] PATH_INFO: `/v3/projects/5f6a3975917a45a6936615d3c25a61b8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:17.730555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6a3975917a45a6936615d3c25a61b8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:17.732466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:17.762320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:17.780060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6a3975917a45a6936615d3c25a61b8', 'request_id': 'req-23c0654a-045e-4c7b-ac10-1ee381b27fa4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.787137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6a3975917a45a6936615d3c25a61b8', 'request_id': 'req-23c0654a-045e-4c7b-ac10-1ee381b27fa4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.792929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6a3975917a45a6936615d3c25a61b8', 'request_id': 'req-23c0654a-045e-4c7b-ac10-1ee381b27fa4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.804471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] The token cache is being invalidate because project 5f6a3975917a45a6936615d3c25a61b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:59:17.804784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.805397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23c0654a-045e-4c7b-ac10-1ee381b27fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:17.807104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1136/2279] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:59:17 2022] DELETE /identity/v3/projects/5f6a3975917a45a6936615d3c25a61b8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:17.812623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb54f4-6d60-4458-9767-c636d394e5af None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:17.812921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb54f4-6d60-4458-9767-c636d394e5af None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:17.813211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb54f4-6d60-4458-9767-c636d394e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:17.841117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-51fb54f4-6d60-4458-9767-c636d394e5af None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:17.842346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-51fb54f4-6d60-4458-9767-c636d394e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:17.912866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1144/2280] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:17.920978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c297970-8863-4b82-aa53-4c820338af30 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:17.921331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c297970-8863-4b82-aa53-4c820338af30 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:17.921614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c297970-8863-4b82-aa53-4c820338af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:17.940658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9c297970-8863-4b82-aa53-4c820338af30 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:17.941900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9c297970-8863-4b82-aa53-4c820338af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:17.949765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1137/2281] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:17.954667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb54f4-6d60-4458-9767-c636d394e5af None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:17.964539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb54f4-6d60-4458-9767-c636d394e5af None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:17.969141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:17.969828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:17.970121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:17.970404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:17.971137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:59:17.971448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:17.973048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:17.984762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1145/2282] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:59:17.988591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c297970-8863-4b82-aa53-4c820338af30 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:17.997560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c297970-8863-4b82-aa53-4c820338af30 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:18.002768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:18.003536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:18.003698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:18.003978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:18.004657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:18.006633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:18.033233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1138/2283] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:59:17 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:18.037345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:18.047417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfcb3a-7120-4e0a-b8ee-f48cf9f8ea6a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:18.064825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:18.107421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:18.108087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:18.108376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:18.108657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:18.109358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:18.111309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:18.131500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1146/2284] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:59:18 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:18.135587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:18.146829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82960d-a65b-4b4d-9a5b-2ed0c71bc5fc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:18.151749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:18.152422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:18.152713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:18.152995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:18.153721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:18.155358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:18.167967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1139/2285] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:59:18.172297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:18.182614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19becd3d-e8fd-4cc5-9efe-358d8c917b34 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:18.188790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00091-520b-4ecd-b05b-464dbf059427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:18.189496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00091-520b-4ecd-b05b-464dbf059427 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:18.189830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00091-520b-4ecd-b05b-464dbf059427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:18.190121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00091-520b-4ecd-b05b-464dbf059427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:18.190865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d00091-520b-4ecd-b05b-464dbf059427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:18.192506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d00091-520b-4ecd-b05b-464dbf059427 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:18.206337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1147/2286] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:59:18.207605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:18.217423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dba08c-f34d-4416-a2df-c3d5b91dfc8c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:18.222094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:18.222967 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:18.223249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:18.223527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] PATH_INFO: `/v3/projects/30337bb676fd46af8a4693a120e607ae/users/cbd8e287fb874d44b7cafb0ab063b95b/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:18.239191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30337bb676fd46af8a4693a120e607ae, user_id=cbd8e287fb874d44b7cafb0ab063b95b, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:18.241763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:18.255653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1140/2287] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:59:18 2022] PUT /identity/v3/projects/30337bb676fd46af8a4693a120e607ae/users/cbd8e287fb874d44b7cafb0ab063b95b/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:18.269918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8a76-7ba2-4011-96e4-3fb701c5c7cf None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:18.269918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8a76-7ba2-4011-96e4-3fb701c5c7cf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:18.269918 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8a76-7ba2-4011-96e4-3fb701c5c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:18.311503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-463b8a76-7ba2-4011-96e4-3fb701c5c7cf None None] MFA Rules not processed for user `cbd8e287fb874d44b7cafb0ab063b95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:18.313275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-463b8a76-7ba2-4011-96e4-3fb701c5c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:18.384324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1148/2288] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:18.397093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:18.399764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:18.460252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0a9d-cfd4-4b32-bd35-5881b4c3a881 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:18.464080 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66db0d-cf22-486f-a052-55a396237af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:18.464997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66db0d-cf22-486f-a052-55a396237af5 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:18.465288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66db0d-cf22-486f-a052-55a396237af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:18.465597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66db0d-cf22-486f-a052-55a396237af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:18.475208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66db0d-cf22-486f-a052-55a396237af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:18.476700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66db0d-cf22-486f-a052-55a396237af5 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:18.490662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1141/2289] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:23.169966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b8a76-7ba2-4011-96e4-3fb701c5c7cf None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:23.234336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b8a76-7ba2-4011-96e4-3fb701c5c7cf None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:23.239379 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:23.240362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:23.240712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:23.240953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] PATH_INFO: `/v3/users/cbd8e287fb874d44b7cafb0ab063b95b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:23.242246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd8e287fb874d44b7cafb0ab063b95b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:23.244129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:23.294309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:23.326820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd8e287fb874d44b7cafb0ab063b95b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:23.337799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd8e287fb874d44b7cafb0ab063b95b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:23.339011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd8e287fb874d44b7cafb0ab063b95b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:23.346571 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd8e287fb874d44b7cafb0ab063b95b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:23.347292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd8e287fb874d44b7cafb0ab063b95b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:23.371111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1149/2290] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:59:23 2022] DELETE /identity/v3/users/cbd8e287fb874d44b7cafb0ab063b95b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:23.377798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:23.377798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:23.377798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:23.405781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:23.407993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:23.471088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:23.487859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1142/2291] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:23.497288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:23.498976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:23.561450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a887d-2d66-4fd8-8b1d-232345a587a0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:23.565135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34937a40-9c68-45f6-a088-c3a5e4ee2c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:23.565801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34937a40-9c68-45f6-a088-c3a5e4ee2c65 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:23.566091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34937a40-9c68-45f6-a088-c3a5e4ee2c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:23.566370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34937a40-9c68-45f6-a088-c3a5e4ee2c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:23.575120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34937a40-9c68-45f6-a088-c3a5e4ee2c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:23.576579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34937a40-9c68-45f6-a088-c3a5e4ee2c65 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:23.586347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1150/2292] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:23.875705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:23.877282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:23.891383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f25d-db17-4ce3-b9e8-073b4bd2cf1d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:23.898418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:23.899492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:23.899837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:23.900118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] PATH_INFO: `/v3/projects/30337bb676fd46af8a4693a120e607ae` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:23.901478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30337bb676fd46af8a4693a120e607ae)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:23.903785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:23.968745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30337bb676fd46af8a4693a120e607ae', 'request_id': 'req-6dce10fd-2586-4485-8cfe-6c41916bc9c6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:23.982933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30337bb676fd46af8a4693a120e607ae', 'request_id': 'req-6dce10fd-2586-4485-8cfe-6c41916bc9c6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:23.991206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30337bb676fd46af8a4693a120e607ae', 'request_id': 'req-6dce10fd-2586-4485-8cfe-6c41916bc9c6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:24.004522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] The token cache is being invalidate because project 30337bb676fd46af8a4693a120e607ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:59:24.004834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:24.005454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6dce10fd-2586-4485-8cfe-6c41916bc9c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:24.007412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1143/2293] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:59:23 2022] DELETE /identity/v3/projects/30337bb676fd46af8a4693a120e607ae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:24.012557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb224ee-bcc5-472d-af45-1705c67ffb3e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.012852 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb224ee-bcc5-472d-af45-1705c67ffb3e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.013137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb224ee-bcc5-472d-af45-1705c67ffb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.032718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fbb224ee-bcc5-472d-af45-1705c67ffb3e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:24.034156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fbb224ee-bcc5-472d-af45-1705c67ffb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:24.097013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1151/2294] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:24.104975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a197b8-f56d-4054-be3f-b1a2b8d07fef None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.105275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a197b8-f56d-4054-be3f-b1a2b8d07fef None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.105565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a197b8-f56d-4054-be3f-b1a2b8d07fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.127473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-33a197b8-f56d-4054-be3f-b1a2b8d07fef None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:24.128762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-33a197b8-f56d-4054-be3f-b1a2b8d07fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:24.136527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1144/2295] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:24.141681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb224ee-bcc5-472d-af45-1705c67ffb3e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:24.151608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb224ee-bcc5-472d-af45-1705c67ffb3e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:24.156426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:24.157341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.157629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.157942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.158676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:59:24.158984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:24.160577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:24.176549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1152/2296] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 09:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:59:24.180402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a197b8-f56d-4054-be3f-b1a2b8d07fef None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:24.190334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a197b8-f56d-4054-be3f-b1a2b8d07fef None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:24.195222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:24.195881 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.196172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.196455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.197157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:24.199169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:24.226090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1145/2297] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 09:59:24 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:24.230609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:24.242520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd858a-c728-40b2-ae44-ed5f9aa2cf3d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:24.276643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:24.302288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:24.303248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.303539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.303825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.304527 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:24.306530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:24.326104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1153/2298] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 09:59:24 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:59:24.330697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:24.340891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e049f1-f0b3-4b5c-b88b-305458a1c958 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:24.346046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:24.346700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.346987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.347331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.347992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:24.349626 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:24.360454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1146/2299] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:59:24.364312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:24.374438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c0be-d205-4c88-bef6-833301c9d9e5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:24.379098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed188d87-2a29-4bc2-a099-8b6cbb704e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:24.379732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188d87-2a29-4bc2-a099-8b6cbb704e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.380018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188d87-2a29-4bc2-a099-8b6cbb704e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.380298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188d87-2a29-4bc2-a099-8b6cbb704e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.381207 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed188d87-2a29-4bc2-a099-8b6cbb704e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:24.382704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed188d87-2a29-4bc2-a099-8b6cbb704e5f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:24.393883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1154/2300] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 09:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:59:24.398015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:24.408816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306760-1e61-458d-8332-c59c4afa471c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:24.413377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:24.414284 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.414571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.414848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] PATH_INFO: `/v3/projects/c3884bf345fa495aa02121995069f0a7/users/4b94b5b9d790494fae410119770bc0ba/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.429523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3884bf345fa495aa02121995069f0a7, user_id=4b94b5b9d790494fae410119770bc0ba, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:24.431855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:24.446073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1147/2301] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 09:59:24 2022] PUT /identity/v3/projects/c3884bf345fa495aa02121995069f0a7/users/4b94b5b9d790494fae410119770bc0ba/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:24.456998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:24.457298 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:24.457587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:24.485939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] MFA Rules not processed for user `4b94b5b9d790494fae410119770bc0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:24.487470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:24.595198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1155/2302] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:26.346290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:26.348031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:26.404550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990a676-5c59-4cc1-a485-266b259fccae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:26.408953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217c299-520a-4452-b99d-f32923e0bd84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:26.409601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217c299-520a-4452-b99d-f32923e0bd84 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:26.409927 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217c299-520a-4452-b99d-f32923e0bd84 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:26.410211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217c299-520a-4452-b99d-f32923e0bd84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:26.418311 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217c299-520a-4452-b99d-f32923e0bd84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:26.419749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217c299-520a-4452-b99d-f32923e0bd84 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:26.429086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1148/2303] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:26.717673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:26.719688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:26.797433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b51e1-1166-4c0c-a3c1-29729ff4474e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:26.803848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:26.804880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:26.805314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:26.805658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] PATH_INFO: `/v3/users/61483e03ddf8498d8139a6e52c4bd6f9` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:26.807059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61483e03ddf8498d8139a6e52c4bd6f9)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:26.809358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:26.880433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61483e03ddf8498d8139a6e52c4bd6f9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:26.881973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:26.891290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61483e03ddf8498d8139a6e52c4bd6f9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:26.892385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61483e03ddf8498d8139a6e52c4bd6f9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:26.902830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61483e03ddf8498d8139a6e52c4bd6f9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:26.903996 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61483e03ddf8498d8139a6e52c4bd6f9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:26.922967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1156/2304] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 09:59:26 2022] DELETE /identity/v3/users/61483e03ddf8498d8139a6e52c4bd6f9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:26.927657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:26.927955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:26.928240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:26.948904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:26.950253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:26.960374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:27.014377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1149/2305] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:27.026685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:27.028302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:27.095902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a5c9d-562e-49d4-9fa1-bca5c51c3dc1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:27.100167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dd840-ab4f-4c17-8990-90d82d1f1e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:27.101120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dd840-ab4f-4c17-8990-90d82d1f1e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:27.101616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dd840-ab4f-4c17-8990-90d82d1f1e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:27.102165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dd840-ab4f-4c17-8990-90d82d1f1e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:27.119550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dd840-ab4f-4c17-8990-90d82d1f1e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:27.121142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dd840-ab4f-4c17-8990-90d82d1f1e53 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:27.134204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1157/2306] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:59:27.506290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:27.507857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:27.529461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78487761-ec1f-451c-918d-acd76dd848d3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:27.536113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:27.537012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:27.537336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:27.537581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] PATH_INFO: `/v3/projects/bb5866c407a44834934130fba59c2e79` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:27.538824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5866c407a44834934130fba59c2e79)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:27.540771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:27.598618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5866c407a44834934130fba59c2e79', 'request_id': 'req-ba9d35fa-243f-4e8d-9587-6ec5283318e6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:27.604963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5866c407a44834934130fba59c2e79', 'request_id': 'req-ba9d35fa-243f-4e8d-9587-6ec5283318e6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:27.611821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5866c407a44834934130fba59c2e79', 'request_id': 'req-ba9d35fa-243f-4e8d-9587-6ec5283318e6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:27.628677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] The token cache is being invalidate because project bb5866c407a44834934130fba59c2e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:59:27.629013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:27.629669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:59:27.633065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1150/2307] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 09:59:27 2022] DELETE /identity/v3/projects/bb5866c407a44834934130fba59c2e79 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:59:37.128799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=38,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:37.624058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:39.668280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:39.668712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:39.668983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:39.686501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] MFA Rules not processed for user `d547e64bcf5d4799af6039df3c9a4ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:39.688363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:39.746835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1158/2308] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:59:47.548919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:47.550538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:47.655572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d35fa-243f-4e8d-9587-6ec5283318e6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:47.661039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ea79c-f89e-4d86-b8c3-b917799fab25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:47.662084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea79c-f89e-4d86-b8c3-b917799fab25 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:47.662377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea79c-f89e-4d86-b8c3-b917799fab25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:47.662657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea79c-f89e-4d86-b8c3-b917799fab25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:47.664507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d76ea79c-f89e-4d86-b8c3-b917799fab25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:47.744039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ea79c-f89e-4d86-b8c3-b917799fab25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:47.745997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ea79c-f89e-4d86-b8c3-b917799fab25 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:47.758600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1151/2309] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:59:49.740104 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=25 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:52.527004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:59:52.528635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:52.644712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3252363-638e-415d-9dcf-789ce8a12785 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:59:52.652698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c68fa1-8cc6-4ce3-b4b0-682e6192055f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:59:52.655808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68fa1-8cc6-4ce3-b4b0-682e6192055f service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:52.656230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68fa1-8cc6-4ce3-b4b0-682e6192055f service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:52.656697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68fa1-8cc6-4ce3-b4b0-682e6192055f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:52.659702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-16c68fa1-8cc6-4ce3-b4b0-682e6192055f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:52.674257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c68fa1-8cc6-4ce3-b4b0-682e6192055f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:59:52.676427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c68fa1-8cc6-4ce3-b4b0-682e6192055f service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:59:52.690352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1159/2310] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 09:59:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:59:54.571747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:59:54.572277 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:59:54.572371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:59:54.590025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] MFA Rules not processed for user `397ff11fedcc4d17867e1d9c10fcd10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:59:54.591266 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:59:54.649407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1152/2311] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:02.684501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=41 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:02.928911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502813-a53b-47f2-8633-b5f642995037 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:02.929199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502813-a53b-47f2-8633-b5f642995037 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:02.929865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502813-a53b-47f2-8633-b5f642995037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:02.951023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-87502813-a53b-47f2-8633-b5f642995037 None None] MFA Rules not processed for user `e62d9d781281497e9927c0eb0e85dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:02.952532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-87502813-a53b-47f2-8633-b5f642995037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:03.042958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1160/2312] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:04.642326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=75 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:05.590477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:05.592042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:05.655551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc04a47-c18f-4ff0-90a3-f5cc8c63e82b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:05.660485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:05.661355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:05.661641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:05.661961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] PATH_INFO: `/v3/users/2a813ceb8f66432194e07aa62bebdd82` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:05.663145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a813ceb8f66432194e07aa62bebdd82)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:05.665061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:05.711068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a813ceb8f66432194e07aa62bebdd82'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:05.718049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a813ceb8f66432194e07aa62bebdd82'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:05.718712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a813ceb8f66432194e07aa62bebdd82'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:05.725510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a813ceb8f66432194e07aa62bebdd82'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:05.726147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a813ceb8f66432194e07aa62bebdd82'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:05.743912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1153/2313] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:00:05 2022] DELETE /identity/v3/users/2a813ceb8f66432194e07aa62bebdd82 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:05.748463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:05.748965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:05.749123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:05.767250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:05.768445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:05.825847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1161/2314] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:05.835278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:05.836690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:05.906865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4111a0-0465-451e-8768-68b87fb25434 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:05.911371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e6ef9-2f59-4103-a9cd-ea711e974971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:05.912095 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6ef9-2f59-4103-a9cd-ea711e974971 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:05.912456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6ef9-2f59-4103-a9cd-ea711e974971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:05.912737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6ef9-2f59-4103-a9cd-ea711e974971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:05.923783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e6ef9-2f59-4103-a9cd-ea711e974971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:05.926314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e6ef9-2f59-4103-a9cd-ea711e974971 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:05.937937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1154/2315] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:06.339573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:06.341043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:06.353005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d358cd-f7c9-4c36-8aca-ac712d73b2cd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:06.358462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:06.359334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.360156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.360474 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] PATH_INFO: `/v3/projects/6adf0be3bda94e5f90356434f340305b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.361653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adf0be3bda94e5f90356434f340305b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:06.363620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:06.421070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adf0be3bda94e5f90356434f340305b', 'request_id': 'req-1f377859-6864-41db-9e55-f8ae816e0c5e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:06.426948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adf0be3bda94e5f90356434f340305b', 'request_id': 'req-1f377859-6864-41db-9e55-f8ae816e0c5e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:06.435015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adf0be3bda94e5f90356434f340305b', 'request_id': 'req-1f377859-6864-41db-9e55-f8ae816e0c5e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:06.447843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] The token cache is being invalidate because project 6adf0be3bda94e5f90356434f340305b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:00:06.448129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:06.448887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1f377859-6864-41db-9e55-f8ae816e0c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:06.452583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1162/2316] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:00:06 2022] DELETE /identity/v3/projects/6adf0be3bda94e5f90356434f340305b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:06.458203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db7aa-592e-4e28-a1f0-e2d0d6bb8f28 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.458504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db7aa-592e-4e28-a1f0-e2d0d6bb8f28 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.458791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db7aa-592e-4e28-a1f0-e2d0d6bb8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.477782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-897db7aa-592e-4e28-a1f0-e2d0d6bb8f28 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:06.479002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-897db7aa-592e-4e28-a1f0-e2d0d6bb8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:06.500796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:06.554491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1155/2317] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:06.562292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450010-8719-4e34-846d-829b9ab0c051 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.563111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450010-8719-4e34-846d-829b9ab0c051 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.563401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450010-8719-4e34-846d-829b9ab0c051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.582337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-40450010-8719-4e34-846d-829b9ab0c051 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:06.583542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-40450010-8719-4e34-846d-829b9ab0c051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:06.591493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1163/2318] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:06.595788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db7aa-592e-4e28-a1f0-e2d0d6bb8f28 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:06.605439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db7aa-592e-4e28-a1f0-e2d0d6bb8f28 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:06.610184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:06.610849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.611134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.611412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.612140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:00:06.612448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:06.614455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:06.630734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1156/2319] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:00:06.632186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450010-8719-4e34-846d-829b9ab0c051 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:06.642630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450010-8719-4e34-846d-829b9ab0c051 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:06.647384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:06.648059 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.648358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.648789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.649510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:06.651487 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:06.673629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:06.684590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1164/2320] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:00:06 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:00:06.685946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:06.697716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675733b-7bf2-4728-86cd-c6bdbd80f65f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:06.757794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:06.758478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.758768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.759047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.759743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:06.761742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:06.782236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1157/2321] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:00:06 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:00:06.786737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:06.797171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c82fd7-8bbb-413d-861e-78804e3947e8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:06.802241 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:06.802909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.803209 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.803467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.804222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:06.805879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:06.818344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1165/2322] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:00:06.822555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:06.833109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd2dc-56c9-43f3-842c-2706ab57ff16 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:06.838050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd1d13-2207-4199-9c09-6e47f7bd4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:06.839296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd1d13-2207-4199-9c09-6e47f7bd4137 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.839296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd1d13-2207-4199-9c09-6e47f7bd4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.839296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd1d13-2207-4199-9c09-6e47f7bd4137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.840149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd1d13-2207-4199-9c09-6e47f7bd4137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:06.841863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd1d13-2207-4199-9c09-6e47f7bd4137 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:06.852843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1158/2323] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:00:06.857067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:06.867400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29206ba-638d-4873-bed5-77d5c3f17cc5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:06.872322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:06.873203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.873524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.873873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] PATH_INFO: `/v3/projects/aa11acd38ae14aeea91a05c97b166960/users/5cf34288d4ee46bcb04347985ebf2fa7/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.889318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa11acd38ae14aeea91a05c97b166960, user_id=5cf34288d4ee46bcb04347985ebf2fa7, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:06.892580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:06.906270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1166/2324] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:00:06 2022] PUT /identity/v3/projects/aa11acd38ae14aeea91a05c97b166960/users/5cf34288d4ee46bcb04347985ebf2fa7/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:06.917650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b2ff-3804-4517-b6f5-95afd7c8fa8e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:06.918162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b2ff-3804-4517-b6f5-95afd7c8fa8e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:06.918466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b2ff-3804-4517-b6f5-95afd7c8fa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:06.947774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f226b2ff-3804-4517-b6f5-95afd7c8fa8e None None] MFA Rules not processed for user `5cf34288d4ee46bcb04347985ebf2fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:06.949107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f226b2ff-3804-4517-b6f5-95afd7c8fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:07.050654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1159/2325] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:07.066206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:07.068251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:07.150657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f305f8-411a-47bd-95a3-169d38c1ddb6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:07.154539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:07.155313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:07.155609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:07.155892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:07.168528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:07.170161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:07.183684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1167/2326] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:08.620258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7ebc-5df2-443e-b8de-f5c5f76075a5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:08.620887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7ebc-5df2-443e-b8de-f5c5f76075a5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:08.620887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7ebc-5df2-443e-b8de-f5c5f76075a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:08.641139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7b1c7ebc-5df2-443e-b8de-f5c5f76075a5 None None] MFA Rules not processed for user `5cf34288d4ee46bcb04347985ebf2fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:08.642384 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7b1c7ebc-5df2-443e-b8de-f5c5f76075a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:08.649573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1160/2327] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:17.176661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:18.634403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:28.087043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:28.088890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:28.158764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5368815-ec11-4ff8-8e6f-7d42f4f73556 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:28.163261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:28.164187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:28.164400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:28.164676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] PATH_INFO: `/v3/users/4b94b5b9d790494fae410119770bc0ba` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:28.166220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b94b5b9d790494fae410119770bc0ba)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:28.168599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:28.229566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b94b5b9d790494fae410119770bc0ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:28.242257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b94b5b9d790494fae410119770bc0ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:28.243093 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b94b5b9d790494fae410119770bc0ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:28.267426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b94b5b9d790494fae410119770bc0ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:28.268077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b94b5b9d790494fae410119770bc0ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:28.291773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1168/2328] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:00:28 2022] DELETE /identity/v3/users/4b94b5b9d790494fae410119770bc0ba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:28.297891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7b77a-98ec-4e14-b29f-9ce55ccb7f65 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:28.298409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7b77a-98ec-4e14-b29f-9ce55ccb7f65 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:28.298602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7b77a-98ec-4e14-b29f-9ce55ccb7f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:28.320593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b3a7b77a-98ec-4e14-b29f-9ce55ccb7f65 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:28.322363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b3a7b77a-98ec-4e14-b29f-9ce55ccb7f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:28.407267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1161/2329] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:28.429074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:28.430638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:28.514310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbf95-d6f2-4d21-84a3-2a292b40398d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:28.520238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:28.521208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:28.521708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:28.522261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:28.538141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:28.540078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:28.552344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1169/2330] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:28.961579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:28.962110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:28.962424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.003830 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.006279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.021322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2fc7-c4c2-4942-964e-d713dcc493bb service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.026071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:29.027262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.027434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.028515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.028515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.028930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] PATH_INFO: `/v3/projects/c3884bf345fa495aa02121995069f0a7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.030335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3884bf345fa495aa02121995069f0a7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.032436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.069025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:29.113645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3884bf345fa495aa02121995069f0a7', 'request_id': 'req-1fcce2be-f948-497b-a613-7bc6f3d3685e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:29.119109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3884bf345fa495aa02121995069f0a7', 'request_id': 'req-1fcce2be-f948-497b-a613-7bc6f3d3685e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:29.131932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3884bf345fa495aa02121995069f0a7', 'request_id': 'req-1fcce2be-f948-497b-a613-7bc6f3d3685e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:29.151011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] The token cache is being invalidate because project c3884bf345fa495aa02121995069f0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:00:29.151011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:29.151355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1fcce2be-f948-497b-a613-7bc6f3d3685e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:29.156936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1170/2331] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:00:29 2022] DELETE /identity/v3/projects/c3884bf345fa495aa02121995069f0a7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:00:29.158929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91048b7-7fd9-4211-b629-2a0d3ef54334 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.159323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91048b7-7fd9-4211-b629-2a0d3ef54334 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.159717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91048b7-7fd9-4211-b629-2a0d3ef54334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.162709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1162/2332] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:29.184826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a91048b7-7fd9-4211-b629-2a0d3ef54334 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:29.187127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a91048b7-7fd9-4211-b629-2a0d3ef54334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.231996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.233541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.290897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1171/2333] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:29.300035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab2a0-8ca3-4454-844f-0a9ac5010d09 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.300421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab2a0-8ca3-4454-844f-0a9ac5010d09 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.301680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab2a0-8ca3-4454-844f-0a9ac5010d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.324272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-601ab2a0-8ca3-4454-844f-0a9ac5010d09 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:29.325732 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-601ab2a0-8ca3-4454-844f-0a9ac5010d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.331705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:29.347344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1172/2334] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:29.348334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab2a0-8ca3-4454-844f-0a9ac5010d09 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.359139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab2a0-8ca3-4454-844f-0a9ac5010d09 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.364623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.365313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.365603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.365934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.366719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:00:29.366978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.368587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.370800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970fc87-6b07-4b01-9985-1a5cc855d846 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.390100 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1173/2335] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 10:00:29.394234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.405613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59060c-4612-451a-89c4-a006acd16952 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.412357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.413602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.413938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.414496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.415092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.416998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.449143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1174/2336] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:00:29 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:00:29.449831 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.450292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.450507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.450784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.451073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.453031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.525904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.527527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.536400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1163/2337] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:00:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:00:29.547715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9118-ead8-4ea4-bd9f-fff2ad257b2d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.553524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.554246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.554532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.554814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.555511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.557450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.575970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:29.598762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1175/2338] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:00:29 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:00:29.599410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.611066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160508b-e023-4fba-a3bf-5d70d5ab257e service swift] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.615818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.616599 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.616971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.617470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.618311 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.620092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.632573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1164/2339] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:00:29.637195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.650377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a2f8f-8d10-4e35-b786-2874ae135c1b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.659052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ecd95-b95c-4394-94d4-dd406f3eb69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.659740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ecd95-b95c-4394-94d4-dd406f3eb69d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.660026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ecd95-b95c-4394-94d4-dd406f3eb69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.660309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ecd95-b95c-4394-94d4-dd406f3eb69d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.661049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ecd95-b95c-4394-94d4-dd406f3eb69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.663259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ecd95-b95c-4394-94d4-dd406f3eb69d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.674676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1176/2340] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:00:29.678468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.689726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df83e4-2786-422f-978b-53e3f43a3c2a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.697522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.698484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.698772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.699054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] PATH_INFO: `/v3/projects/8efa58ca5f4346aaa332846b7434e5ad/users/32b6a4b89a5e4f1fb6f4ee7f1973dfcf/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.717042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efa58ca5f4346aaa332846b7434e5ad, user_id=32b6a4b89a5e4f1fb6f4ee7f1973dfcf, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.720152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:29.737484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1165/2341] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:00:29 2022] PUT /identity/v3/projects/8efa58ca5f4346aaa332846b7434e5ad/users/32b6a4b89a5e4f1fb6f4ee7f1973dfcf/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:00:29.747840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909b8c-fec1-44f3-84aa-f636d1f55ea0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.748314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909b8c-fec1-44f3-84aa-f636d1f55ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.748705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909b8c-fec1-44f3-84aa-f636d1f55ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.790107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-18909b8c-fec1-44f3-84aa-f636d1f55ea0 None None] MFA Rules not processed for user `32b6a4b89a5e4f1fb6f4ee7f1973dfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:29.791359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-18909b8c-fec1-44f3-84aa-f636d1f55ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.875359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1177/2342] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:29.887643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:29.889675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:29.966625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:29.974163 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4e9a8-0e41-4e96-8017-fc2037c86756 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:29.978723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d645f-ed35-4312-af10-c28a6f1e7ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:29.979567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d645f-ed35-4312-af10-c28a6f1e7ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:29.980035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d645f-ed35-4312-af10-c28a6f1e7ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:29.980809 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d645f-ed35-4312-af10-c28a6f1e7ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:29.992036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d645f-ed35-4312-af10-c28a6f1e7ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:29.993915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d645f-ed35-4312-af10-c28a6f1e7ba1 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:30.006381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1166/2343] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:30.036870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909b8c-fec1-44f3-84aa-f636d1f55ea0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:30.135089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909b8c-fec1-44f3-84aa-f636d1f55ea0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:30.155437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:30.157400 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:30.161581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:30.162217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] PATH_INFO: `/v3/users/32b6a4b89a5e4f1fb6f4ee7f1973dfcf` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:30.165160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b6a4b89a5e4f1fb6f4ee7f1973dfcf)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:30.167396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:30.247301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b6a4b89a5e4f1fb6f4ee7f1973dfcf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:30.258005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b6a4b89a5e4f1fb6f4ee7f1973dfcf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:30.258878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b6a4b89a5e4f1fb6f4ee7f1973dfcf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:30.271770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b6a4b89a5e4f1fb6f4ee7f1973dfcf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:30.274540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b6a4b89a5e4f1fb6f4ee7f1973dfcf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:30.296544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:30.312672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1178/2344] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:00:30 2022] DELETE /identity/v3/users/32b6a4b89a5e4f1fb6f4ee7f1973dfcf => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:30.317407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:30.317826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:30.318156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:30.339331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:30.340912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:30.465801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1167/2345] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:30.476078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:30.477872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:30.550272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0cd8f-65ab-4a9a-80c3-667c2d60628b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:30.554718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9b86-590f-4c17-a58d-09151db52940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:30.555363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9b86-590f-4c17-a58d-09151db52940 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:30.555645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9b86-590f-4c17-a58d-09151db52940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:30.555919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9b86-590f-4c17-a58d-09151db52940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:30.573303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb9b86-590f-4c17-a58d-09151db52940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:30.575107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb9b86-590f-4c17-a58d-09151db52940 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:30.589208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1179/2346] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:31.015339 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:31.022330 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:31.054008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765ada6-3e39-4fd1-8280-394f38bd8cd3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:31.058940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:31.060481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.060481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.060711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] PATH_INFO: `/v3/projects/8efa58ca5f4346aaa332846b7434e5ad` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.063543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efa58ca5f4346aaa332846b7434e5ad)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:31.065712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:31.145738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efa58ca5f4346aaa332846b7434e5ad', 'request_id': 'req-1bbf4771-fa18-46ef-b134-9800dca13a87'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:31.157210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efa58ca5f4346aaa332846b7434e5ad', 'request_id': 'req-1bbf4771-fa18-46ef-b134-9800dca13a87'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:31.166080 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efa58ca5f4346aaa332846b7434e5ad', 'request_id': 'req-1bbf4771-fa18-46ef-b134-9800dca13a87'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:31.184250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] The token cache is being invalidate because project 8efa58ca5f4346aaa332846b7434e5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:00:31.184485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:31.185291 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1bbf4771-fa18-46ef-b134-9800dca13a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:31.191831 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1168/2347] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:00:31 2022] DELETE /identity/v3/projects/8efa58ca5f4346aaa332846b7434e5ad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:31.193863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19476c9-a98d-470c-a1bc-a53c27ccb614 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.194362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19476c9-a98d-470c-a1bc-a53c27ccb614 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.194469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19476c9-a98d-470c-a1bc-a53c27ccb614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.213708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d19476c9-a98d-470c-a1bc-a53c27ccb614 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:31.214972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d19476c9-a98d-470c-a1bc-a53c27ccb614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:31.302003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1180/2348] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:31.304123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1129-d220-478c-9d0f-ab04406cba1a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.304429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1129-d220-478c-9d0f-ab04406cba1a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.304722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1129-d220-478c-9d0f-ab04406cba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.326117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-846f1129-d220-478c-9d0f-ab04406cba1a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:31.327336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-846f1129-d220-478c-9d0f-ab04406cba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:31.338692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1169/2349] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:31.340265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19476c9-a98d-470c-a1bc-a53c27ccb614 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:31.362191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19476c9-a98d-470c-a1bc-a53c27ccb614 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:31.374677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:31.376056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.376340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.376618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.377363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:00:31.377667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:31.381822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:31.407001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1181/2350] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:00:31.409601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1129-d220-478c-9d0f-ab04406cba1a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:31.426149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1129-d220-478c-9d0f-ab04406cba1a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:31.432217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:31.432904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.433302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.433575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.434574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:31.441136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:31.494900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1170/2351] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:00:31 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:00:31.498892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:31.512523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2645b-215f-4e5a-8a92-363b3e816066 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:31.619164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:31.619848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.620140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.620420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.621127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:31.623794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:31.665376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1182/2352] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:00:31 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:00:31.667487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:31.686895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8de0-4552-482e-805f-b37d9420486b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:31.709835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:31.710534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.710831 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.711112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.724721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:31.731794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:31.775015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1171/2353] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:00:31.776244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:31.793874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d81ab-0d97-4249-a7bc-f5c70570a477 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:31.804858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a030ddc-0a08-447a-8542-d085eb01d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:31.805630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030ddc-0a08-447a-8542-d085eb01d339 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.806147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030ddc-0a08-447a-8542-d085eb01d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.806260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030ddc-0a08-447a-8542-d085eb01d339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.810123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a030ddc-0a08-447a-8542-d085eb01d339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:31.813529 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a030ddc-0a08-447a-8542-d085eb01d339 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:31.826809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:31.835563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1183/2354] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:00:31.839416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:31.857226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c6d0-1829-430a-aa2f-d1f34d2d523f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:31.867074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:31.872123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.872942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.873344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] PATH_INFO: `/v3/projects/475a588bd5a64b508dadf3d93fa5370c/users/3b1e4b0732d34ec896c84cb52a297447/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.902246 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475a588bd5a64b508dadf3d93fa5370c, user_id=3b1e4b0732d34ec896c84cb52a297447, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:31.905245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:31.929715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1172/2355] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:00:31 2022] PUT /identity/v3/projects/475a588bd5a64b508dadf3d93fa5370c/users/3b1e4b0732d34ec896c84cb52a297447/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:31.934266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:31.934680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:31.935086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:31.966461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:31.970811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:32.153565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1184/2356] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:32.184731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:32.188289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:32.218650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:32.377794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e6737-e3ca-4138-ba97-4593a5d25102 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:32.383805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cedf0-ca1d-4a1c-8c65-e29dd0e84a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:32.384481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cedf0-ca1d-4a1c-8c65-e29dd0e84a1b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:32.384773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cedf0-ca1d-4a1c-8c65-e29dd0e84a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:32.385059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cedf0-ca1d-4a1c-8c65-e29dd0e84a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:32.398988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cedf0-ca1d-4a1c-8c65-e29dd0e84a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:32.400812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cedf0-ca1d-4a1c-8c65-e29dd0e84a1b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:32.415543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1173/2357] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:35.203865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:35.205365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:35.228626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4768fa2-05f6-4ac9-a6e6-be7b35d60735 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:35.232707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:35.233630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:35.234168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:35.234727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:35.239790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:35.352642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:35.355147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:35.370360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1185/2358] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:41.233709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da6cf-18cd-48f1-98bc-fc427840a602 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:41.235895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da6cf-18cd-48f1-98bc-fc427840a602 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:41.235895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da6cf-18cd-48f1-98bc-fc427840a602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:41.269696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b63da6cf-18cd-48f1-98bc-fc427840a602 None None] MFA Rules not processed for user `3b1e4b0732d34ec896c84cb52a297447`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:41.271310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b63da6cf-18cd-48f1-98bc-fc427840a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:41.397798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1174/2359] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:41.402318 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:41.421128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528aef-7c9b-423d-80a2-995051e56fba service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:41.434564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:41.435255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:41.435629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:41.436054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:41.439928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:41.439928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:41.512444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1186/2360] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:00:41 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:00:41.513616 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da6cf-18cd-48f1-98bc-fc427840a602 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:41.526319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da6cf-18cd-48f1-98bc-fc427840a602 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:41.727605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:41.728308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:41.728600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:41.728883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:41.729690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:41.731569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:41.784691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1175/2361] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:00:41 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:00:41.785893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:41.803122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68f161-0f7a-471f-96c7-89dcf81c292a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:41.820773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:41.821468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:41.821776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:41.822069 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:41.822896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:41.831404 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:41.867226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1187/2362] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:00:41.867952 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:41.888544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550a7f-ce13-498c-b34d-eb5e9558464b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:41.907547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:41.908807 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:41.909010 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:41.909294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] PATH_INFO: `/v3/projects/40fb3851e78d485f940132cbc99f7ad0/users/bbe6635b5b5146e799f4f992a7cd918b/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:41.959521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fb3851e78d485f940132cbc99f7ad0, user_id=bbe6635b5b5146e799f4f992a7cd918b, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:41.965157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:42.001738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:42.002673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1176/2363] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:00:41 2022] PUT /identity/v3/projects/40fb3851e78d485f940132cbc99f7ad0/users/bbe6635b5b5146e799f4f992a7cd918b/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:42.018442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1ec91-bfdc-4643-9c93-ea207d17aa9f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:42.198994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced765a6-f05b-4eb5-a109-a94b028c79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:42.199691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced765a6-f05b-4eb5-a109-a94b028c79a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:42.200042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced765a6-f05b-4eb5-a109-a94b028c79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:42.200333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced765a6-f05b-4eb5-a109-a94b028c79a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:42.209799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced765a6-f05b-4eb5-a109-a94b028c79a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:42.209799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced765a6-f05b-4eb5-a109-a94b028c79a2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:42.216030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:42.255407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1188/2364] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:00:42.259272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:42.282667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce384-1fcb-457d-98b7-08a2de1f21a3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:42.288764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:42.289920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:42.290194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:42.290536 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] PATH_INFO: `/v3/projects/40fb3851e78d485f940132cbc99f7ad0/users/bbe6635b5b5146e799f4f992a7cd918b/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:42.294142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fb3851e78d485f940132cbc99f7ad0, user_id=bbe6635b5b5146e799f4f992a7cd918b, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:42.299170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:42.310769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:42.350059 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1177/2365] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:00:42 2022] PUT /identity/v3/projects/40fb3851e78d485f940132cbc99f7ad0/users/bbe6635b5b5146e799f4f992a7cd918b/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:48.310203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25859e2-41ea-4c98-afb1-dfe330256160 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:48.310757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25859e2-41ea-4c98-afb1-dfe330256160 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:48.310872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25859e2-41ea-4c98-afb1-dfe330256160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:48.344808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e25859e2-41ea-4c98-afb1-dfe330256160 None None] MFA Rules not processed for user `bbe6635b5b5146e799f4f992a7cd918b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:48.346054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e25859e2-41ea-4c98-afb1-dfe330256160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:48.461495 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1189/2366] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:48.467540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:48.479396 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:48.624228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772fd2-72b4-43af-abd9-86ca0908ca46 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:48.631896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a895caa-8c23-4cf4-b43f-749bd92cd912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:48.632574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895caa-8c23-4cf4-b43f-749bd92cd912 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:48.632861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895caa-8c23-4cf4-b43f-749bd92cd912 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:48.633144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895caa-8c23-4cf4-b43f-749bd92cd912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:48.722819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a895caa-8c23-4cf4-b43f-749bd92cd912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:48.725418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a895caa-8c23-4cf4-b43f-749bd92cd912 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:48.742623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1178/2367] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:50.546115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:50.546541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:50.546647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:50.585839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] MFA Rules not processed for user `3b1e4b0732d34ec896c84cb52a297447`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:50.587317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:50.598604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1190/2368] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:50.793153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c170a-aa9b-438f-bcb3-792b55f22707 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:50.793627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c170a-aa9b-438f-bcb3-792b55f22707 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:50.793722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c170a-aa9b-438f-bcb3-792b55f22707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:50.814233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e54c170a-aa9b-438f-bcb3-792b55f22707 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:50.815488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e54c170a-aa9b-438f-bcb3-792b55f22707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:50.886643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1179/2369] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 10:00:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:50.902418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:50.904190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:51.014447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4872-43ae-4b17-b871-2838ce51b4d7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:51.021410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:51.022152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:51.022631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:51.023129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:51.054425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:51.056684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:51.067905 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1191/2370] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:00:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:00:51.812518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d651db-92f3-4730-b929-526c5b38514f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:51.813009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d651db-92f3-4730-b929-526c5b38514f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:51.813227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d651db-92f3-4730-b929-526c5b38514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:51.833656 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d8d651db-92f3-4730-b929-526c5b38514f None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:51.835009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d8d651db-92f3-4730-b929-526c5b38514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:51.844307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1180/2371] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 3 10:00:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:51.860672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:51.879025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bb8a-6bfa-4965-a865-e831992b7296 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:51.891416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:51.892709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:51.893506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:51.894899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:51.909118 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:51.911120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:51.921694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1192/2372] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:00:52.130361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0afc1-de8c-4792-8f52-93e659959885 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:52.130654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0afc1-de8c-4792-8f52-93e659959885 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:52.130934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0afc1-de8c-4792-8f52-93e659959885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:52.148150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-04d0afc1-de8c-4792-8f52-93e659959885 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:52.149346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-04d0afc1-de8c-4792-8f52-93e659959885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:52.158829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1181/2373] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:52.173815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:52.186723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63580aa5-c8eb-495d-9bce-bf927db89fcf service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:52.197533 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:52.198617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:52.198911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:52.199193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:52.211662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:52.213211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:52.223281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1193/2374] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:00:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:00:52.618015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:52.618313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:52.618602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:52.625465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:52.644093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:52.645598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:52.667925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1182/2375] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 3 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:52.683112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:52.699715 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46be68-2423-4582-a9d1-c77cde35286a service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:52.707549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31689ccb-7ab4-4ff9-be46-d021eade827e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:52.708208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689ccb-7ab4-4ff9-be46-d021eade827e service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:52.708635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689ccb-7ab4-4ff9-be46-d021eade827e service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:52.708923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689ccb-7ab4-4ff9-be46-d021eade827e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:52.719458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31689ccb-7ab4-4ff9-be46-d021eade827e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:52.721322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31689ccb-7ab4-4ff9-be46-d021eade827e service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:52.747509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1194/2376] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:00:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:00:54.915406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:54.916838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:54.981638 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db4350-89e6-4a28-9cb6-74a5d779d74c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:54.991502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:54.992334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:54.992629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:54.992962 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] PATH_INFO: `/v3/users/5cf34288d4ee46bcb04347985ebf2fa7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:54.994443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf34288d4ee46bcb04347985ebf2fa7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:54.996545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:55.069404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf34288d4ee46bcb04347985ebf2fa7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.087359 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf34288d4ee46bcb04347985ebf2fa7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.088117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf34288d4ee46bcb04347985ebf2fa7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.097326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf34288d4ee46bcb04347985ebf2fa7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.098416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf34288d4ee46bcb04347985ebf2fa7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.123790 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1183/2377] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:00:54 2022] DELETE /identity/v3/users/5cf34288d4ee46bcb04347985ebf2fa7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:55.128564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:55.129013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:55.129290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:55.151302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:55.152663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:55.185705 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:55.240364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1195/2378] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:00:55.254114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:55.256119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:55.342692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8ffb3-2bbe-4093-8468-37134e9fa8a1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:55.346815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8b2c-dcc7-41d0-8bf4-d4d529e06059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:55.347447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8b2c-dcc7-41d0-8bf4-d4d529e06059 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:55.347736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8b2c-dcc7-41d0-8bf4-d4d529e06059 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:55.348110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8b2c-dcc7-41d0-8bf4-d4d529e06059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:55.370643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8b2c-dcc7-41d0-8bf4-d4d529e06059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:55.372268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8b2c-dcc7-41d0-8bf4-d4d529e06059 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:55.401298 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1184/2379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:55.640327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:55.642088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:55.663090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d871d-41bf-45eb-b462-ba100256c5d1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:55.669743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:55.670988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:55.671277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:55.671620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] PATH_INFO: `/v3/projects/aa11acd38ae14aeea91a05c97b166960` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:55.673619 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa11acd38ae14aeea91a05c97b166960)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:55.675707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:55.746617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa11acd38ae14aeea91a05c97b166960', 'request_id': 'req-74e82f26-6a9a-42ff-9ff4-0797f83f4446'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.752444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa11acd38ae14aeea91a05c97b166960', 'request_id': 'req-74e82f26-6a9a-42ff-9ff4-0797f83f4446'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.763264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa11acd38ae14aeea91a05c97b166960', 'request_id': 'req-74e82f26-6a9a-42ff-9ff4-0797f83f4446'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.773951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] The token cache is being invalidate because project aa11acd38ae14aeea91a05c97b166960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:00:55.774511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.775233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74e82f26-6a9a-42ff-9ff4-0797f83f4446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:00:55.777343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1196/2380] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:00:55 2022] DELETE /identity/v3/projects/aa11acd38ae14aeea91a05c97b166960 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:00:56.033985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f527da8-cbc9-47c7-9258-cd2a3ef781d5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.034516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f527da8-cbc9-47c7-9258-cd2a3ef781d5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.034631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f527da8-cbc9-47c7-9258-cd2a3ef781d5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.036079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1185/2381] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 10:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 10:00:56.056358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35533-1e5c-49c4-9784-f034af21fa2b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.056812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35533-1e5c-49c4-9784-f034af21fa2b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.057240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35533-1e5c-49c4-9784-f034af21fa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.094607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6ee35533-1e5c-49c4-9784-f034af21fa2b None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:56.095840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6ee35533-1e5c-49c4-9784-f034af21fa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:56.168742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1197/2382] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 10:00:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:56.180958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f527da8-cbc9-47c7-9258-cd2a3ef781d5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:56.182787 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9f527da8-cbc9-47c7-9258-cd2a3ef781d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:56.205789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:56.267086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f527da8-cbc9-47c7-9258-cd2a3ef781d5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:56.270550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b331d47-ecf9-4eaf-b189-2e2ae84de938 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:56.271189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331d47-ecf9-4eaf-b189-2e2ae84de938 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.271473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331d47-ecf9-4eaf-b189-2e2ae84de938 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.271753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331d47-ecf9-4eaf-b189-2e2ae84de938 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.282134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b331d47-ecf9-4eaf-b189-2e2ae84de938 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:56.283817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b331d47-ecf9-4eaf-b189-2e2ae84de938 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:56.294602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1186/2383] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:00:56.361155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055be844-fa5e-49fd-bde0-e8c11075d8de None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.361447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055be844-fa5e-49fd-bde0-e8c11075d8de None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.361729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055be844-fa5e-49fd-bde0-e8c11075d8de None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.363141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1198/2384] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 10:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 10:00:56.367847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d5b5-b008-4b18-a3df-5d72a66a0b05 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.368139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d5b5-b008-4b18-a3df-5d72a66a0b05 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.368417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d5b5-b008-4b18-a3df-5d72a66a0b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.395374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c1c6d5b5-b008-4b18-a3df-5d72a66a0b05 None None] MFA Rules not processed for user `2585af8b95ea48d1a3576bd722536fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:56.396605 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c1c6d5b5-b008-4b18-a3df-5d72a66a0b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:56.448622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1187/2385] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 10:00:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:56.461525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055be844-fa5e-49fd-bde0-e8c11075d8de None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:56.463342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-055be844-fa5e-49fd-bde0-e8c11075d8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:56.477105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055be844-fa5e-49fd-bde0-e8c11075d8de None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:56.481147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12277169-d33e-4843-97b7-07cd0cd202a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:56.481989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277169-d33e-4843-97b7-07cd0cd202a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.482381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277169-d33e-4843-97b7-07cd0cd202a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.482765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277169-d33e-4843-97b7-07cd0cd202a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.491042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12277169-d33e-4843-97b7-07cd0cd202a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:56.492483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12277169-d33e-4843-97b7-07cd0cd202a1 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:56.501322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1199/2386] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 10:00:56.584361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85511-df10-469e-b1a8-f12e5551e1aa None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.584662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85511-df10-469e-b1a8-f12e5551e1aa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.584950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85511-df10-469e-b1a8-f12e5551e1aa None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.586383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1188/2387] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 10:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 10:00:56.591994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc386f5-2b77-4319-b973-33191666fb3f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.592292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc386f5-2b77-4319-b973-33191666fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.592599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc386f5-2b77-4319-b973-33191666fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.610748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1bc386f5-2b77-4319-b973-33191666fb3f None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:00:56.611921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1bc386f5-2b77-4319-b973-33191666fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:00:56.620970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1200/2388] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 10:00:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:00:56.631618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d85511-df10-469e-b1a8-f12e5551e1aa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:00:56.643197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d85511-df10-469e-b1a8-f12e5551e1aa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:00:56.646816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:00:56.647445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:00:56.647729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:00:56.648007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:00:56.658460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:00:56.659943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:00:56.672024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1189/2389] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:00:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:01:00.222848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9398abe-42c4-4296-90fa-43f62d1c88f5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:00.223330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9398abe-42c4-4296-90fa-43f62d1c88f5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:00.223428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9398abe-42c4-4296-90fa-43f62d1c88f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:00.241661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b9398abe-42c4-4296-90fa-43f62d1c88f5 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:01:00.242888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b9398abe-42c4-4296-90fa-43f62d1c88f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:00.247515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:00.305405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1201/2390] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:01:00.317601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:01:00.319077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:00.389814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35957-1fac-4cba-af24-41dbb5241766 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:01:00.395738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:01:00.396445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:00.396828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:00.397015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:00.406533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:01:00.408191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:01:00.416508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1190/2391] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:01:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 10:01:10.297836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=21 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:10.413176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:38.584957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:38.585524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:38.585524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:38.610954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:01:38.612275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:38.626363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1202/2392] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 3 10:01:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:01:38.643837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:01:38.655117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec52dc3-d1cc-4b68-b7f8-26fe17e385d9 service swift] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:01:38.661178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:01:38.661990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:38.662367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:38.662658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:38.672474 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:01:38.674148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:01:38.682588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1191/2393] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:01:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:01:38.956785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:01:38.958398 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:38.970614 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978d92-022d-47fb-b571-2a47f7f14ebe None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:01:38.974120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:01:38.974752 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:38.975032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:38.975309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:38.977005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:38.990204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:01:38.991622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:01:39.002544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1203/2394] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:01:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:01:41.010527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:01:41.023937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4929c-13a1-481a-9f82-a698f95a57f1 service swift] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:01:41.028337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:01:41.029066 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:41.029475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:41.029873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:41.031829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:41.047644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:01:41.049085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:01:41.061275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1192/2395] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:01:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:01:44.922881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:01:44.931348 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c198-f816-4ab6-aba8-dd5a729b5327 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:01:44.934917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a01449-077d-4e3d-b491-8b557b95d2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:01:44.935544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01449-077d-4e3d-b491-8b557b95d2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:44.935828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01449-077d-4e3d-b491-8b557b95d2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:44.936108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01449-077d-4e3d-b491-8b557b95d2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:44.937851 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c5a01449-077d-4e3d-b491-8b557b95d2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:44.999294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a01449-077d-4e3d-b491-8b557b95d2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:01:45.000739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a01449-077d-4e3d-b491-8b557b95d2ae service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:01:45.010061 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1204/2396] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:01:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:01:45.978036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:01:45.987904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c7d4-1dca-40cb-ad32-a58bac9261bd service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:01:45.991651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:01:45.992480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:45.992783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:45.993181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:45.995346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:46.058488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:01:46.059910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:01:46.070233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1193/2397] 10.222.0.45 () {60 vars in 1396 bytes} [Fri Jun 3 10:01:45 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:01:54.434835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:01:54.435307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:01:54.435401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:01:54.453173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] MFA Rules not processed for user `d547e64bcf5d4799af6039df3c9a4ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:01:54.454402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:01:54.461616 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1205/2398] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:01:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:01:56.065975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=40 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:00.818583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:00.828189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fe30a-eee6-4808-8cca-33b8b25980bf service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:00.833217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:00.834648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:00.834648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:00.835065 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:00.837256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:00.850319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:00.851818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:00.860748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1194/2399] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:02:02.928484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:02.929958 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:02.943377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=43 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:02.950655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2acf60-503d-4ffb-9e84-51fca93b2c8f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:02.956167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5fc12-b326-4d62-9cea-d8e49ecb88b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:02.956935 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5fc12-b326-4d62-9cea-d8e49ecb88b6 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:02.957226 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5fc12-b326-4d62-9cea-d8e49ecb88b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:02.957507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5fc12-b326-4d62-9cea-d8e49ecb88b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:02.959323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-83e5fc12-b326-4d62-9cea-d8e49ecb88b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:03.020360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5fc12-b326-4d62-9cea-d8e49ecb88b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:03.021938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5fc12-b326-4d62-9cea-d8e49ecb88b6 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:03.031464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1206/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:02:07.354824 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:07.356845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:07.373481 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0de0-e4b6-4d3b-9a6e-f38995b93666 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:07.384308 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:07.385133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:07.385524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:07.393343 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:07.395587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:07.410098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:07.412069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:07.424174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1195/2401] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:02:13.026964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=27 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:17.418584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=12 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:18.879420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:18.879924 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:18.880029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:18.897140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] MFA Rules not processed for user `e62d9d781281497e9927c0eb0e85dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:02:18.898296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:18.905601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1207/2402] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:02:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:02:19.200161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:19.210124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af410ab-a712-4314-8dc0-5e8f75991990 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:19.213727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:19.214388 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:19.214673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:19.214977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:19.216741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:19.227181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:19.228633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:19.236764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1196/2403] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 10:02:19.540016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:19.541652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:19.616565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281442c-4f22-4f89-8b36-9d1618cfdb9b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:19.621544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:19.622213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:19.622498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:19.622776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:19.625118 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:19.636140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:19.637721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:19.649075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1208/2404] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:02:28.859479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:28.873355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918fe8c-e1a1-48f0-ac4c-78688dba1377 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:28.878894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:28.879540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:28.879832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:28.880111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:28.881959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:28.894606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:28.896194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:28.907452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1197/2405] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:02:29.643848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=35 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:33.484624 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:33.497258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267e6e-f74d-4955-8584-891a3b7e96f4 service placement] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:33.503409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949d30f-7504-48f1-abe3-733ee9ce51b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:33.504057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949d30f-7504-48f1-abe3-733ee9ce51b6 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:33.504344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949d30f-7504-48f1-abe3-733ee9ce51b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:33.504623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949d30f-7504-48f1-abe3-733ee9ce51b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:33.506518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b949d30f-7504-48f1-abe3-733ee9ce51b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:33.523323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949d30f-7504-48f1-abe3-733ee9ce51b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:33.524936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949d30f-7504-48f1-abe3-733ee9ce51b6 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:33.536213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1209/2406] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:02:38.902217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=12 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:42.893479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:42.904771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c5ca-6e91-4549-aa11-284838b309ab service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:42.910584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a45427-1ac6-4313-9ba1-27480d770429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:42.911240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45427-1ac6-4313-9ba1-27480d770429 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:42.911530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45427-1ac6-4313-9ba1-27480d770429 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:42.911845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a45427-1ac6-4313-9ba1-27480d770429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:42.913715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-27a45427-1ac6-4313-9ba1-27480d770429 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:42.972239 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a45427-1ac6-4313-9ba1-27480d770429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:42.973882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a45427-1ac6-4313-9ba1-27480d770429 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:42.984564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1198/2407] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:02:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:02:43.531395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:52.979678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=28 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:54.891951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bb99e-cab6-4014-b1e9-5d2fa7d17d60 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:54.892515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bb99e-cab6-4014-b1e9-5d2fa7d17d60 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:54.892515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bb99e-cab6-4014-b1e9-5d2fa7d17d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:54.910961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f13bb99e-cab6-4014-b1e9-5d2fa7d17d60 None None] MFA Rules not processed for user `c216711b9e9b45f09f4917fe7b8275ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:02:54.912170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f13bb99e-cab6-4014-b1e9-5d2fa7d17d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:54.919073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1210/2408] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:02:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:02:58.411625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919da95-8ce0-4dcc-967f-13f27c482339 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:58.412081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919da95-8ce0-4dcc-967f-13f27c482339 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:58.412218 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919da95-8ce0-4dcc-967f-13f27c482339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:58.430301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2919da95-8ce0-4dcc-967f-13f27c482339 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:02:58.431540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2919da95-8ce0-4dcc-967f-13f27c482339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:02:58.438928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1199/2409] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 3 10:02:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:02:58.492371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bb99e-cab6-4014-b1e9-5d2fa7d17d60 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:02:58.506251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bb99e-cab6-4014-b1e9-5d2fa7d17d60 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:02:58.512807 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e15d-533c-4a48-8350-18460c39b126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:02:58.513470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e15d-533c-4a48-8350-18460c39b126 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:02:58.513983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e15d-533c-4a48-8350-18460c39b126 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:02:58.514483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e15d-533c-4a48-8350-18460c39b126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:02:58.523301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e15d-533c-4a48-8350-18460c39b126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:02:58.524890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e15d-533c-4a48-8350-18460c39b126 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:02:58.535686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1211/2410] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:02:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:02.685364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07e2b-c675-499a-b58d-f312763f5558 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:02.685874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07e2b-c675-499a-b58d-f312763f5558 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:02.685999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07e2b-c675-499a-b58d-f312763f5558 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:02.687984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1200/2411] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 10:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 10:03:02.717149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08803dc-c68f-4127-af47-cea512b49a1f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:02.717684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08803dc-c68f-4127-af47-cea512b49a1f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:02.717862 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08803dc-c68f-4127-af47-cea512b49a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:02.762366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f08803dc-c68f-4127-af47-cea512b49a1f None None] MFA Rules not processed for user `33c559aafd5f4ebdbc3bb654926d2c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:02.763608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f08803dc-c68f-4127-af47-cea512b49a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:02.775228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1212/2412] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 10:03:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:02.786424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd07e2b-c675-499a-b58d-f312763f5558 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:02.788134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7dd07e2b-c675-499a-b58d-f312763f5558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:02.807292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd07e2b-c675-499a-b58d-f312763f5558 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:02.813417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:02.814136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:02.814426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:02.814719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:02.826425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:02.828085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:02.839725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1201/2413] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:06.256780 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08803dc-c68f-4127-af47-cea512b49a1f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:06.268882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08803dc-c68f-4127-af47-cea512b49a1f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:06.274135 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:06.274787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:06.275075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:06.275473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:06.277294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:06.289520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:06.291168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:06.301955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1213/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:06.316637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:06.318263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:06.390567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e49d7e-eee2-4290-adcf-ff4f1f156a34 service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:06.395222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:06.396103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:06.396391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:06.396672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] PATH_INFO: `/v3/users/7f67bf225f3a4ac5bcf07dde077101fd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:06.397884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f67bf225f3a4ac5bcf07dde077101fd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:06.399812 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:06.446705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f67bf225f3a4ac5bcf07dde077101fd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.453360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f67bf225f3a4ac5bcf07dde077101fd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.454045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f67bf225f3a4ac5bcf07dde077101fd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.463231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f67bf225f3a4ac5bcf07dde077101fd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.463852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f67bf225f3a4ac5bcf07dde077101fd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.483369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1202/2415] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:06 2022] DELETE /identity/v3/users/7f67bf225f3a4ac5bcf07dde077101fd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:06.678478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:06.689946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffa7ea-9928-4eac-ac02-b63249cc3df9 service placement] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:06.748639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:06.749543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:06.749866 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:06.750153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] PATH_INFO: `/v3/projects/d3c4a1843a98436c81df8111244795ac` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:06.751327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c4a1843a98436c81df8111244795ac)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:06.753223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:06.798748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c4a1843a98436c81df8111244795ac', 'request_id': 'req-9fa02500-c4a5-4e1c-91e2-d70405175dd4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.804301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c4a1843a98436c81df8111244795ac', 'request_id': 'req-9fa02500-c4a5-4e1c-91e2-d70405175dd4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.812088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c4a1843a98436c81df8111244795ac', 'request_id': 'req-9fa02500-c4a5-4e1c-91e2-d70405175dd4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.823296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] The token cache is being invalidate because project d3c4a1843a98436c81df8111244795ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:06.823582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.824217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.825735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1214/2416] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:06 2022] DELETE /identity/v3/projects/d3c4a1843a98436c81df8111244795ac => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:06.829719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:06.831148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:06.845361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81522f27-16ee-47fd-ba74-634efb782c30 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:06.900873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:06.901792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:06.902083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:06.902362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] PATH_INFO: `/v3/users/c6e16c8606024a6a8e0239b6694179c7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:06.903534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e16c8606024a6a8e0239b6694179c7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:06.905479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:06.906959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:06.955567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e16c8606024a6a8e0239b6694179c7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.962492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e16c8606024a6a8e0239b6694179c7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.963173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e16c8606024a6a8e0239b6694179c7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.970431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e16c8606024a6a8e0239b6694179c7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.971061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c1b40e12-999c-48a9-a71a-2c4d0be268e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e16c8606024a6a8e0239b6694179c7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:06.989413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1203/2417] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:06 2022] DELETE /identity/v3/users/c6e16c8606024a6a8e0239b6694179c7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:07.234795 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:07.236384 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:07.250602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02500-c4a5-4e1c-91e2-d70405175dd4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:07.286523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:07.311485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:07.312876 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:07.313167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:07.313448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] PATH_INFO: `/v3/projects/dfbcd684e221425787338add92f823b6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:07.314665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbcd684e221425787338add92f823b6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:07.316573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:07.362930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbcd684e221425787338add92f823b6', 'request_id': 'req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:07.368340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbcd684e221425787338add92f823b6', 'request_id': 'req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:07.375817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbcd684e221425787338add92f823b6', 'request_id': 'req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:07.387821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] The token cache is being invalidate because project dfbcd684e221425787338add92f823b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:07.388202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:07.388925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:07.391064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1215/2418] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:07 2022] DELETE /identity/v3/projects/dfbcd684e221425787338add92f823b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:16.987540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:17.384144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:18.125495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:18.126108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:18.126108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:18.143475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] MFA Rules not processed for user `397ff11fedcc4d17867e1d9c10fcd10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:18.144677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:18.197150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1204/2419] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:18.507369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:18.508826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:18.569274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7e76-05ef-4d0e-8afb-c21304fa3e0d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:18.574035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:18.574716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:18.575007 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:18.575290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:18.577070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:18.589912 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:18.591351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:18.600452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1216/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:23.540430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:23.542519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:23.556574 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4181d4d-fd19-414e-8fac-4e97623a5b26 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:23.561113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:23.562083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:23.562570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:23.563043 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:23.565081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:23.656759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:23.658633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:23.672376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1205/2421] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:27.863260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:27.864708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:27.880542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b08b93-42d7-4056-b04a-902169f24832 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:27.885146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:27.886043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:27.886331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:27.886612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] PATH_INFO: `/v3/users/d547e64bcf5d4799af6039df3c9a4ea6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:27.887817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d547e64bcf5d4799af6039df3c9a4ea6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:27.890332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:27.936542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd547e64bcf5d4799af6039df3c9a4ea6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:27.943409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd547e64bcf5d4799af6039df3c9a4ea6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:27.944062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd547e64bcf5d4799af6039df3c9a4ea6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:27.951184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd547e64bcf5d4799af6039df3c9a4ea6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:27.952476 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c106accc-cc1d-4cce-94fc-a219f3a34eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd547e64bcf5d4799af6039df3c9a4ea6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:27.970612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1217/2422] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:27 2022] DELETE /identity/v3/users/d547e64bcf5d4799af6039df3c9a4ea6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:28.145642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.156896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b04170-0a0d-4dcc-939c-5df0792e77ed service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.214999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.215874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.216166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.216455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] PATH_INFO: `/v3/projects/b96e7e1b09a04adbba3bd083328ecb71` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.218203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96e7e1b09a04adbba3bd083328ecb71)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.220129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.265264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:28.274358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96e7e1b09a04adbba3bd083328ecb71', 'request_id': 'req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:28.280752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96e7e1b09a04adbba3bd083328ecb71', 'request_id': 'req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:28.287272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96e7e1b09a04adbba3bd083328ecb71', 'request_id': 'req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:28.301360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] The token cache is being invalidate because project b96e7e1b09a04adbba3bd083328ecb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:28.301856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:28.302562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d207dc7d-8bd6-4e57-8172-6faa8480ba3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:28.304240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1206/2423] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:28 2022] DELETE /identity/v3/projects/b96e7e1b09a04adbba3bd083328ecb71 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:28.309350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657c3e-d658-4a13-9e18-04803a785aa6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.309871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657c3e-d658-4a13-9e18-04803a785aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.310191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657c3e-d658-4a13-9e18-04803a785aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.328844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d1657c3e-d658-4a13-9e18-04803a785aa6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:28.330079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d1657c3e-d658-4a13-9e18-04803a785aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:28.392412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1218/2424] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:03:28.400143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a954-b0db-4e86-82c2-6170c1fb9ae1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.400437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a954-b0db-4e86-82c2-6170c1fb9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.400724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a954-b0db-4e86-82c2-6170c1fb9ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.418890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4127a954-b0db-4e86-82c2-6170c1fb9ae1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:28.420104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4127a954-b0db-4e86-82c2-6170c1fb9ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:28.428446 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1207/2425] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:28.432452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657c3e-d658-4a13-9e18-04803a785aa6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.442597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657c3e-d658-4a13-9e18-04803a785aa6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.447335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.447986 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.448273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.448553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.449297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:03:28.449608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.451238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.462711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1219/2426] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:03:28.466715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127a954-b0db-4e86-82c2-6170c1fb9ae1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.475667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127a954-b0db-4e86-82c2-6170c1fb9ae1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.480288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.480924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.481210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.481487 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.482232 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.484647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.518671 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1208/2427] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:28 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:28.522588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.527649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:28.534060 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea86114-ea10-4fbf-a82d-2d5ea4e0e604 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.594202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.594865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.595151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.595430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.596111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.598044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.618704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1220/2428] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:28 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:28.622783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.633724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb5fd3-e61f-4d36-98eb-21419fd74e02 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.638568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.639216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.639523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.639799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.640519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.642151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.651794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1209/2429] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:28.655750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.665740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f656e7-11ee-40b1-95de-a34340c50aa7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.670419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a071a-8a2b-4e36-8fea-a04483f0dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.671572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a071a-8a2b-4e36-8fea-a04483f0dd79 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.671861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a071a-8a2b-4e36-8fea-a04483f0dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.672146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a071a-8a2b-4e36-8fea-a04483f0dd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.673004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a071a-8a2b-4e36-8fea-a04483f0dd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.674676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a071a-8a2b-4e36-8fea-a04483f0dd79 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.684451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1221/2430] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:03:28.688965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.698857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793f0a2-fee0-43d5-ac36-804754f2d760 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.703792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.704852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.705147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.705471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] PATH_INFO: `/v3/projects/d3084b4587c9445bb98f05ef495949a5/users/af4bf91aafc644a2b27ae943507dfd54/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.720999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3084b4587c9445bb98f05ef495949a5, user_id=af4bf91aafc644a2b27ae943507dfd54, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.723715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.736785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1210/2431] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:28 2022] PUT /identity/v3/projects/d3084b4587c9445bb98f05ef495949a5/users/af4bf91aafc644a2b27ae943507dfd54/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:28.746870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2114-4a0d-4399-bd32-aa8379feffe8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.747168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2114-4a0d-4399-bd32-aa8379feffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.747449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2114-4a0d-4399-bd32-aa8379feffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.775497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-028a2114-4a0d-4399-bd32-aa8379feffe8 None None] MFA Rules not processed for user `af4bf91aafc644a2b27ae943507dfd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:28.776708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-028a2114-4a0d-4399-bd32-aa8379feffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:28.840142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1222/2432] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:28.851233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:28.852886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:28.929564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6a189-a995-4bb7-b1f5-829c065fb999 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:28.935164 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01ba20-950d-41af-89a9-7607794b0ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:28.935810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01ba20-950d-41af-89a9-7607794b0ae3 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:28.936101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01ba20-950d-41af-89a9-7607794b0ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:28.936905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01ba20-950d-41af-89a9-7607794b0ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:28.944528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01ba20-950d-41af-89a9-7607794b0ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:28.946154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01ba20-950d-41af-89a9-7607794b0ae3 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:28.955439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1211/2433] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:31.614132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a2114-4a0d-4399-bd32-aa8379feffe8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:31.683013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a2114-4a0d-4399-bd32-aa8379feffe8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:31.687997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:31.688863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:31.689161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:31.689494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] PATH_INFO: `/v3/users/af4bf91aafc644a2b27ae943507dfd54` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:31.691217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4bf91aafc644a2b27ae943507dfd54)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:31.693240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:31.710549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:31.753622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4bf91aafc644a2b27ae943507dfd54'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:31.761239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4bf91aafc644a2b27ae943507dfd54'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:31.762032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4bf91aafc644a2b27ae943507dfd54'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:31.771694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4bf91aafc644a2b27ae943507dfd54'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:31.772453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4bf91aafc644a2b27ae943507dfd54'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:31.797675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1223/2434] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:31 2022] DELETE /identity/v3/users/af4bf91aafc644a2b27ae943507dfd54 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:31.802075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:31.802988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:31.803429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:31.824422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:31.826770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:31.870220 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:31.903139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1212/2435] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:03:31.914598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:31.916188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:31.979381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a5e7e-97fc-49c7-8f97-2173178be781 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:31.983082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178ccba-3d26-4053-a0e7-edb8a25355f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:31.983756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ccba-3d26-4053-a0e7-edb8a25355f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:31.984046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ccba-3d26-4053-a0e7-edb8a25355f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:31.984328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ccba-3d26-4053-a0e7-edb8a25355f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:31.993628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178ccba-3d26-4053-a0e7-edb8a25355f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:31.995092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178ccba-3d26-4053-a0e7-edb8a25355f2 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.005376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1224/2436] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:32.281029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:32.282576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:32.298719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490a619-fe82-4bc8-afe0-ff4572c5b1ec None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:32.303665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:32.304613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.306147 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.306562 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] PATH_INFO: `/v3/projects/d3084b4587c9445bb98f05ef495949a5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.308021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3084b4587c9445bb98f05ef495949a5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:32.310535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.361160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3084b4587c9445bb98f05ef495949a5', 'request_id': 'req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:32.367331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3084b4587c9445bb98f05ef495949a5', 'request_id': 'req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:32.372765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3084b4587c9445bb98f05ef495949a5', 'request_id': 'req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:32.385214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] The token cache is being invalidate because project d3084b4587c9445bb98f05ef495949a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:32.385554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:32.386209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-de4994c1-0cea-48d1-8b5d-f2cd8e697cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:32.387803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1213/2437] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:32 2022] DELETE /identity/v3/projects/d3084b4587c9445bb98f05ef495949a5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:32.393566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167dfb-19d3-4fb3-b462-76db52b53a56 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.393697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167dfb-19d3-4fb3-b462-76db52b53a56 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.394017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167dfb-19d3-4fb3-b462-76db52b53a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.412397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-72167dfb-19d3-4fb3-b462-76db52b53a56 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:32.413531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-72167dfb-19d3-4fb3-b462-76db52b53a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:32.474827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1225/2438] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:03:32.482705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145eba5-82df-4c00-8cb9-38ad2c16d60e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.482978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145eba5-82df-4c00-8cb9-38ad2c16d60e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.483267 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145eba5-82df-4c00-8cb9-38ad2c16d60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.501468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5145eba5-82df-4c00-8cb9-38ad2c16d60e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:32.502703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5145eba5-82df-4c00-8cb9-38ad2c16d60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:32.510920 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1214/2439] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:32.515485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72167dfb-19d3-4fb3-b462-76db52b53a56 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:32.525461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72167dfb-19d3-4fb3-b462-76db52b53a56 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:32.530734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:32.531397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.531689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.531974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.532760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:03:32.533109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:32.534864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.547562 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1226/2440] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 10:03:32.551992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145eba5-82df-4c00-8cb9-38ad2c16d60e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:32.561675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145eba5-82df-4c00-8cb9-38ad2c16d60e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:32.566553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:32.567209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.567497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.567777 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.568598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:32.570889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.603033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1215/2441] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:32 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:32.604204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:32.615581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96536b-5b20-404c-8265-d4bc2d56ef76 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:32.634112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:32.677812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:32.678433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.678723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.679003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.679695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:32.681625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.700790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1227/2442] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:32 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:32.705449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:32.715636 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94618e-c31a-40b3-8c92-67f60b67b5cc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:32.720181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:32.720835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.721125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.721409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.722168 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:32.723772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.734015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1216/2443] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:32.737873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:32.747727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da226-8aee-4948-82c4-62dffea06aa8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:32.752874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98cd73-b3fc-4e11-9c96-8c2b44cc80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:32.753516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98cd73-b3fc-4e11-9c96-8c2b44cc80d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.753833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98cd73-b3fc-4e11-9c96-8c2b44cc80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.754112 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98cd73-b3fc-4e11-9c96-8c2b44cc80d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.754825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98cd73-b3fc-4e11-9c96-8c2b44cc80d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:32.756402 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98cd73-b3fc-4e11-9c96-8c2b44cc80d6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.766737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1228/2444] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:32.770715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:32.780465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76fd9b-914b-4e7f-9741-76ddbe94c995 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:32.785071 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:32.786235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.786521 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.786799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] PATH_INFO: `/v3/projects/c7abb0ba7999459d9a200eeb1c17f505/users/3aad8a223c79474a83cd42410f7b4d12/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.801096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7abb0ba7999459d9a200eeb1c17f505, user_id=3aad8a223c79474a83cd42410f7b4d12, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:32.803848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:32.818233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1217/2445] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:32 2022] PUT /identity/v3/projects/c7abb0ba7999459d9a200eeb1c17f505/users/3aad8a223c79474a83cd42410f7b4d12/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:32.830269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a60df-33ca-4943-969a-c6ee88f48167 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:32.830570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a60df-33ca-4943-969a-c6ee88f48167 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:32.830893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a60df-33ca-4943-969a-c6ee88f48167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:32.859079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9b7a60df-33ca-4943-969a-c6ee88f48167 None None] MFA Rules not processed for user `3aad8a223c79474a83cd42410f7b4d12`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:32.860278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9b7a60df-33ca-4943-969a-c6ee88f48167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:32.932220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1229/2446] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:03:33.099719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:33.101939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:33.172949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:33.189869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f0b22-f73a-4073-bbcd-774299ac0a62 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:33.196436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73303-3c3c-4963-92ae-e59da17fcb47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:33.197237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73303-3c3c-4963-92ae-e59da17fcb47 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:33.197583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73303-3c3c-4963-92ae-e59da17fcb47 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:33.197968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73303-3c3c-4963-92ae-e59da17fcb47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:33.211578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73303-3c3c-4963-92ae-e59da17fcb47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:33.213176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73303-3c3c-4963-92ae-e59da17fcb47 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:33.223428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1218/2447] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:33.435504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a60df-33ca-4943-969a-c6ee88f48167 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:33.498414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a60df-33ca-4943-969a-c6ee88f48167 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:33.503046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:33.503943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:33.504236 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:33.504517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] PATH_INFO: `/v3/users/3aad8a223c79474a83cd42410f7b4d12` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:33.505710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aad8a223c79474a83cd42410f7b4d12)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:33.507663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:33.540942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:33.555549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aad8a223c79474a83cd42410f7b4d12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:33.562243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aad8a223c79474a83cd42410f7b4d12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:33.562891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aad8a223c79474a83cd42410f7b4d12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:33.569909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aad8a223c79474a83cd42410f7b4d12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:33.570517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aad8a223c79474a83cd42410f7b4d12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:33.587296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1230/2448] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:33 2022] DELETE /identity/v3/users/3aad8a223c79474a83cd42410f7b4d12 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:33.591750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:33.592046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:33.592842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:33.610587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:33.611794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:33.670436 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1219/2449] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:33.680019 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:33.681493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:33.737555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cf37f-5f32-4a5e-8ec2-16d8c87e8a58 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:33.741111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e90e24-4614-442c-a210-83d6a8d2bf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:33.741777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90e24-4614-442c-a210-83d6a8d2bf54 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:33.742071 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90e24-4614-442c-a210-83d6a8d2bf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:33.742349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90e24-4614-442c-a210-83d6a8d2bf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:33.751359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e90e24-4614-442c-a210-83d6a8d2bf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:33.752802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e90e24-4614-442c-a210-83d6a8d2bf54 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:33.762608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1231/2450] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:34.040810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.043430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:34.058693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717a3a-1be7-41e2-b963-157ccaec5fa1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.064063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.064924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.065213 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.065492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] PATH_INFO: `/v3/projects/c7abb0ba7999459d9a200eeb1c17f505` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.066742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7abb0ba7999459d9a200eeb1c17f505)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.068660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.130463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7abb0ba7999459d9a200eeb1c17f505', 'request_id': 'req-f6eb39a2-1d09-4cea-801d-ec35ef037898'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:34.136975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7abb0ba7999459d9a200eeb1c17f505', 'request_id': 'req-f6eb39a2-1d09-4cea-801d-ec35ef037898'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:34.144035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7abb0ba7999459d9a200eeb1c17f505', 'request_id': 'req-f6eb39a2-1d09-4cea-801d-ec35ef037898'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:34.158508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] The token cache is being invalidate because project c7abb0ba7999459d9a200eeb1c17f505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:34.158914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:34.159555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6eb39a2-1d09-4cea-801d-ec35ef037898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:34.161424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1220/2451] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:34 2022] DELETE /identity/v3/projects/c7abb0ba7999459d9a200eeb1c17f505 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:34.166668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507878-87d2-41eb-8375-e3727c9aa1e3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.166966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507878-87d2-41eb-8375-e3727c9aa1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.167261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507878-87d2-41eb-8375-e3727c9aa1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.185796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-96507878-87d2-41eb-8375-e3727c9aa1e3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:34.186745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-96507878-87d2-41eb-8375-e3727c9aa1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:34.273407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1232/2452] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:34.282156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699e7f8-4b68-4601-afec-0619e3a14b97 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.282450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699e7f8-4b68-4601-afec-0619e3a14b97 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.282733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699e7f8-4b68-4601-afec-0619e3a14b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.302417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f699e7f8-4b68-4601-afec-0619e3a14b97 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:34.303610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f699e7f8-4b68-4601-afec-0619e3a14b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:34.312024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1221/2453] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:34.316146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507878-87d2-41eb-8375-e3727c9aa1e3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.325897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507878-87d2-41eb-8375-e3727c9aa1e3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.331191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.331851 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.332141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.332424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.333156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:03:34.333472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.335139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.347553 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1233/2454] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:03:34.352060 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699e7f8-4b68-4601-afec-0619e3a14b97 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.361985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699e7f8-4b68-4601-afec-0619e3a14b97 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.366836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.367504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.367810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.368081 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.368779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.370730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.399406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1222/2455] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:34 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:34.403457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.414046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22088bec-f8cc-48e2-a62b-3460bddd3659 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.446280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:34.471870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.472534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.472824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.473107 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.473827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.475794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.495052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1234/2456] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:34 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:34.499243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.509458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ec40-9030-42e8-890a-8e8d0eda563f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.514079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.515225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.515508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.515781 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.516496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.518117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.528411 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1223/2457] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:34.532856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.543018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b639b2-e553-4a55-b69e-3222019971a9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.547648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9d309-6146-4934-8b95-64861c35708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.548299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9d309-6146-4934-8b95-64861c35708f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.548588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9d309-6146-4934-8b95-64861c35708f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.548869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9d309-6146-4934-8b95-64861c35708f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.549588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9d309-6146-4934-8b95-64861c35708f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.551205 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9d309-6146-4934-8b95-64861c35708f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.561594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1235/2458] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:34.565537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.575184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121bf35-ebef-4b4c-9dc2-3ceb75289402 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.580310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.581175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.581461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.581766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] PATH_INFO: `/v3/projects/090e6632988445a5ae8a82833ea1fdf0/users/6dade449ab364078815fcbaa1ed69c0e/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.597448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090e6632988445a5ae8a82833ea1fdf0, user_id=6dade449ab364078815fcbaa1ed69c0e, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.600138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.615691 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1224/2459] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:34 2022] PUT /identity/v3/projects/090e6632988445a5ae8a82833ea1fdf0/users/6dade449ab364078815fcbaa1ed69c0e/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:34.627130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01194a6-ba1e-4abf-8901-e3d311d90387 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.627427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01194a6-ba1e-4abf-8901-e3d311d90387 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.627713 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01194a6-ba1e-4abf-8901-e3d311d90387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.654440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f01194a6-ba1e-4abf-8901-e3d311d90387 None None] MFA Rules not processed for user `6dade449ab364078815fcbaa1ed69c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:34.656206 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f01194a6-ba1e-4abf-8901-e3d311d90387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:34.720423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1236/2460] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:34.724870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.733782 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:34.787473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddfb0-af84-4518-ac63-310305bdcf29 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.792053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.792711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.793006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.793286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.794013 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.795908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.821096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1225/2461] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:34 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:34.825098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01194a6-ba1e-4abf-8901-e3d311d90387 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.835896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01194a6-ba1e-4abf-8901-e3d311d90387 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.892850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.893513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.893832 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.894117 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.894818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.896731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.916451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1237/2462] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:34 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:34.920445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.930822 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52dc2a-f697-40c3-9706-d80c4746cba6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.935555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.936706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.936997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.937280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.938042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.939651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:34.950029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1226/2463] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:34.954716 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:34.964747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef3cf6-5239-4355-b9be-05fa514ada77 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:34.969450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:34.970361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:34.970651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:34.970934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] PATH_INFO: `/v3/projects/432df3623bb946b2aa194ed5f1cefd76/users/c1106acc42814a29b1811ad8fb1301ca/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:34.985165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] RBAC: Authorizing `identity:create_grant(project_id=432df3623bb946b2aa194ed5f1cefd76, user_id=c1106acc42814a29b1811ad8fb1301ca, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:34.987856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:35.000848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1238/2464] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:34 2022] PUT /identity/v3/projects/432df3623bb946b2aa194ed5f1cefd76/users/c1106acc42814a29b1811ad8fb1301ca/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:03:35.004672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:35.014428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c340b-9da9-4dfc-8a49-b5826225dddd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:35.073850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b8dc5-f7db-40f9-ba5e-8f8ca8ea69ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:35.074475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8dc5-f7db-40f9-ba5e-8f8ca8ea69ed admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:35.074741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8dc5-f7db-40f9-ba5e-8f8ca8ea69ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:35.075022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8dc5-f7db-40f9-ba5e-8f8ca8ea69ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:35.075742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b8dc5-f7db-40f9-ba5e-8f8ca8ea69ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:35.077352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b8dc5-f7db-40f9-ba5e-8f8ca8ea69ed admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:35.087351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1227/2465] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:35.091494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:35.102262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccfd66-4048-4615-ac01-58125ee7694b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:35.106858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:35.107709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:35.108050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:35.108823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] PATH_INFO: `/v3/projects/432df3623bb946b2aa194ed5f1cefd76/users/c1106acc42814a29b1811ad8fb1301ca/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:35.110794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] RBAC: Authorizing `identity:create_grant(project_id=432df3623bb946b2aa194ed5f1cefd76, user_id=c1106acc42814a29b1811ad8fb1301ca, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:35.113417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:35.118797 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:35.124381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1239/2466] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:35 2022] PUT /identity/v3/projects/432df3623bb946b2aa194ed5f1cefd76/users/c1106acc42814a29b1811ad8fb1301ca/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:35.136014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c373355-d36e-44f4-875d-e9f56a97fea2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:35.136312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c373355-d36e-44f4-875d-e9f56a97fea2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:35.136594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c373355-d36e-44f4-875d-e9f56a97fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:35.163211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7c373355-d36e-44f4-875d-e9f56a97fea2 None None] MFA Rules not processed for user `c1106acc42814a29b1811ad8fb1301ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:35.164427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7c373355-d36e-44f4-875d-e9f56a97fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:35.231039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1228/2467] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:35.242742 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:35.244419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:35.307486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16401180-44ab-4003-8f00-a4c4e468587a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:35.312631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:35.313281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:35.313572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:35.313887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:35.324764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:35.326213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:35.336323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1240/2468] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:35.411049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c373355-d36e-44f4-875d-e9f56a97fea2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:35.415722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:35.422889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c373355-d36e-44f4-875d-e9f56a97fea2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:35.426897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ae22-9364-48aa-894c-e05753777f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:35.427545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ae22-9364-48aa-894c-e05753777f72 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:35.427833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ae22-9364-48aa-894c-e05753777f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:35.428120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ae22-9364-48aa-894c-e05753777f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:35.486928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ae22-9364-48aa-894c-e05753777f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:35.488410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ae22-9364-48aa-894c-e05753777f72 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:35.497200 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1229/2469] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:45.299106 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:45.360285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459179a5-ab8f-4c0d-941a-d2b848f71821 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:45.364977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:45.365899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:45.366188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:45.366475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] PATH_INFO: `/v3/users/6dade449ab364078815fcbaa1ed69c0e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:45.367655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dade449ab364078815fcbaa1ed69c0e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:45.369566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:45.417702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dade449ab364078815fcbaa1ed69c0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:45.424678 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dade449ab364078815fcbaa1ed69c0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:45.425346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dade449ab364078815fcbaa1ed69c0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:45.432777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dade449ab364078815fcbaa1ed69c0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:45.433399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dade449ab364078815fcbaa1ed69c0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:45.451122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1241/2470] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:45 2022] DELETE /identity/v3/users/6dade449ab364078815fcbaa1ed69c0e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:03:45.455708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:45.456203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:45.456321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:45.473269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:45.474491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:45.531471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1230/2471] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:03:45.541247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:45.542684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:45.565372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:45.603591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29a8d-d8e0-4638-8c35-ef43f99038a2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:45.607210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:45.607896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:45.608703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:45.609003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:45.618210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:45.619729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:45.629284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1242/2472] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:45.899497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:45.900909 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:45.915377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee1aa3-954a-40b0-94ca-a066a2f48904 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:45.920428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:45.921374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:45.921736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:45.922109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] PATH_INFO: `/v3/projects/090e6632988445a5ae8a82833ea1fdf0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:45.930647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090e6632988445a5ae8a82833ea1fdf0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:45.932608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:45.979347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090e6632988445a5ae8a82833ea1fdf0', 'request_id': 'req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:45.985936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090e6632988445a5ae8a82833ea1fdf0', 'request_id': 'req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:45.991578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090e6632988445a5ae8a82833ea1fdf0', 'request_id': 'req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.004283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] The token cache is being invalidate because project 090e6632988445a5ae8a82833ea1fdf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:46.004573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.005195 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.006847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1231/2473] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:45 2022] DELETE /identity/v3/projects/090e6632988445a5ae8a82833ea1fdf0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:46.010803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:46.020238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad513-8197-4402-95b6-11105e58270f service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:46.076774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:46.077640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:46.077971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:46.078254 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] PATH_INFO: `/v3/users/c1106acc42814a29b1811ad8fb1301ca` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:46.079459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1106acc42814a29b1811ad8fb1301ca)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:46.081373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:46.133628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1106acc42814a29b1811ad8fb1301ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.142598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1106acc42814a29b1811ad8fb1301ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.143682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1106acc42814a29b1811ad8fb1301ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.151156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1106acc42814a29b1811ad8fb1301ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.151833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-976822d7-4f86-4ebd-a183-4341ef87cd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1106acc42814a29b1811ad8fb1301ca'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.169834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1243/2474] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:46 2022] DELETE /identity/v3/users/c1106acc42814a29b1811ad8fb1301ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:46.474344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:46.475915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:46.489578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b985a-233e-4a0f-85d3-a1ed6d9b4824 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:46.516271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:46.566549 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:46.567440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:46.567731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:46.568017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] PATH_INFO: `/v3/projects/432df3623bb946b2aa194ed5f1cefd76` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:46.569231 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432df3623bb946b2aa194ed5f1cefd76)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:46.571184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:46.626038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432df3623bb946b2aa194ed5f1cefd76', 'request_id': 'req-a2756689-949e-4583-b1a1-296272dba432'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.632611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432df3623bb946b2aa194ed5f1cefd76', 'request_id': 'req-a2756689-949e-4583-b1a1-296272dba432'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.640523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432df3623bb946b2aa194ed5f1cefd76', 'request_id': 'req-a2756689-949e-4583-b1a1-296272dba432'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.658966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] The token cache is being invalidate because project 432df3623bb946b2aa194ed5f1cefd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:46.659327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.660142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a2756689-949e-4583-b1a1-296272dba432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:46.662109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1232/2475] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:46 2022] DELETE /identity/v3/projects/432df3623bb946b2aa194ed5f1cefd76 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:46.667281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d8069-4313-43d9-96f1-1b696c45c599 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:46.667801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d8069-4313-43d9-96f1-1b696c45c599 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:46.668173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d8069-4313-43d9-96f1-1b696c45c599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:46.688210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0b4d8069-4313-43d9-96f1-1b696c45c599 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:46.689579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0b4d8069-4313-43d9-96f1-1b696c45c599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:46.732012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:46.760357 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1244/2476] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:46.768371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e498cf-4b33-434d-83b9-f5304c33fc86 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:46.768680 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e498cf-4b33-434d-83b9-f5304c33fc86 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:46.768945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e498cf-4b33-434d-83b9-f5304c33fc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:46.788377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-30e498cf-4b33-434d-83b9-f5304c33fc86 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:46.789554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-30e498cf-4b33-434d-83b9-f5304c33fc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:46.798532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1233/2477] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:46.802824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d8069-4313-43d9-96f1-1b696c45c599 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:46.815504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d8069-4313-43d9-96f1-1b696c45c599 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:46.821143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:46.822058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:46.822426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:46.822710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:46.823527 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:03:46.823843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:46.825468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:46.838120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1245/2478] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:03:46.843204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e498cf-4b33-434d-83b9-f5304c33fc86 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:46.853730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e498cf-4b33-434d-83b9-f5304c33fc86 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:46.859623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:46.860305 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:46.860592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:46.860868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:46.861565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:46.863546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:46.900030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1234/2479] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:46 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:46.904260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:46.917680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4efbb-4ff3-4ba4-928f-c921cf1ecc29 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:46.984999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:46.985672 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:46.986003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:46.986281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:46.986979 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:46.988899 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.009647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1246/2480] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:46 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:47.013422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.028368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ddc6-333f-4ea6-93ac-f588565b6e06 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.033368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.034192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.034479 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.034759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.035493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.037624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.052300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1235/2481] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:47.056802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.067507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1336a79-9db3-4ef8-92f2-293f906ede8d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.082399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b9bc7-5342-4068-9152-13a603d6c8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.083097 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b9bc7-5342-4068-9152-13a603d6c8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.083386 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b9bc7-5342-4068-9152-13a603d6c8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.083665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b9bc7-5342-4068-9152-13a603d6c8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.084409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b9bc7-5342-4068-9152-13a603d6c8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.086063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b9bc7-5342-4068-9152-13a603d6c8a4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.097698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1247/2482] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:47.101870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.113242 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db357e1-04b5-48e7-aa56-37fa5639cb90 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.119601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.120897 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.121296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.121584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] PATH_INFO: `/v3/projects/c4f892dc77cc4cdbb1ec44d72487a947/users/c8f61f41d4aa4ab5afcfb43239ffb601/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.137567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f892dc77cc4cdbb1ec44d72487a947, user_id=c8f61f41d4aa4ab5afcfb43239ffb601, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.141064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.156736 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1236/2483] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:47 2022] PUT /identity/v3/projects/c4f892dc77cc4cdbb1ec44d72487a947/users/c8f61f41d4aa4ab5afcfb43239ffb601/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:47.169646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe3f9-2af1-4c99-a121-1381fccdd321 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.169973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe3f9-2af1-4c99-a121-1381fccdd321 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.170756 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe3f9-2af1-4c99-a121-1381fccdd321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.198584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8d4fe3f9-2af1-4c99-a121-1381fccdd321 None None] MFA Rules not processed for user `c8f61f41d4aa4ab5afcfb43239ffb601`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:47.199689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8d4fe3f9-2af1-4c99-a121-1381fccdd321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:47.268999 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1248/2484] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:47.273551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.333872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:47.347870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e6a1c-4b2d-4f8f-846a-c85664ca3cba admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.354110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.354922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.355460 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.356039 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.357121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.359859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.414624 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1237/2485] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:47 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:47.414946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe3f9-2af1-4c99-a121-1381fccdd321 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.431661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe3f9-2af1-4c99-a121-1381fccdd321 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.475662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:47.511850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.512643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.513692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.513692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.514005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.517076 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.544875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1249/2486] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:47 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:47.548940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.562619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3252c-890a-467a-906b-fbf0a4fe6d18 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.570114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.570917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.571241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.571502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.572254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.584564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.605804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1238/2487] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:47.610957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.622988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b191a-c488-49a6-acf6-446f15a33f0e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.628265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.629143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.629520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.630655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] PATH_INFO: `/v3/projects/e92c5cb27e8d43ec9d5a778f6bbaf598/users/6b79cf6d35c24fa1affb1adb7d808563/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.649338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92c5cb27e8d43ec9d5a778f6bbaf598, user_id=6b79cf6d35c24fa1affb1adb7d808563, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.652396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.669178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1250/2488] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:47 2022] PUT /identity/v3/projects/e92c5cb27e8d43ec9d5a778f6bbaf598/users/6b79cf6d35c24fa1affb1adb7d808563/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:47.673377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.683749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1eb3-0002-4fe1-b856-c53990d786dc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.742833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c082-4ede-444e-ac84-d3c1bfb33ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.743507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c082-4ede-444e-ac84-d3c1bfb33ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.743795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c082-4ede-444e-ac84-d3c1bfb33ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.744079 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c082-4ede-444e-ac84-d3c1bfb33ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.744802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c082-4ede-444e-ac84-d3c1bfb33ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.746457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c082-4ede-444e-ac84-d3c1bfb33ee6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.757283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1239/2489] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:47.762511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.773175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9db2b-d688-4317-affa-5c1c3e1b5f0c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:47.777941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:47.778823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.779110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.779387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] PATH_INFO: `/v3/projects/e92c5cb27e8d43ec9d5a778f6bbaf598/users/6b79cf6d35c24fa1affb1adb7d808563/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.781927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92c5cb27e8d43ec9d5a778f6bbaf598, user_id=6b79cf6d35c24fa1affb1adb7d808563, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:47.784546 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:47.796114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1251/2490] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:47 2022] PUT /identity/v3/projects/e92c5cb27e8d43ec9d5a778f6bbaf598/users/6b79cf6d35c24fa1affb1adb7d808563/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:03:47.806423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00673-c841-43fc-a446-3b1b995d32e1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:47.806805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00673-c841-43fc-a446-3b1b995d32e1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:47.807153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00673-c841-43fc-a446-3b1b995d32e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:47.834678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a5a00673-c841-43fc-a446-3b1b995d32e1 None None] MFA Rules not processed for user `6b79cf6d35c24fa1affb1adb7d808563`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:47.835815 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a5a00673-c841-43fc-a446-3b1b995d32e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:47.918749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1240/2491] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:47.929656 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:47.932412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:48.004645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddcac0-dc1a-4e6f-9670-1518c3959d59 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:48.008519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c379-89a6-4a31-a07c-4ddff7263253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:48.009184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c379-89a6-4a31-a07c-4ddff7263253 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:48.009470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c379-89a6-4a31-a07c-4ddff7263253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:48.009778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c379-89a6-4a31-a07c-4ddff7263253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:48.021280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c379-89a6-4a31-a07c-4ddff7263253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:48.022639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c379-89a6-4a31-a07c-4ddff7263253 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:48.039401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1252/2492] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:48.128335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a00673-c841-43fc-a446-3b1b995d32e1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:48.138965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a00673-c841-43fc-a446-3b1b995d32e1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:48.143609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:48.144335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:48.144694 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:48.145110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:48.192776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:48.207301 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:48.208789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:48.219256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1241/2493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:51.224980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b944fdb-1593-4646-8601-983ebfc1c2bb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:51.225503 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b944fdb-1593-4646-8601-983ebfc1c2bb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:51.225760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b944fdb-1593-4646-8601-983ebfc1c2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:51.245068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8b944fdb-1593-4646-8601-983ebfc1c2bb None None] MFA Rules not processed for user `e62d9d781281497e9927c0eb0e85dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:51.246279 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8b944fdb-1593-4646-8601-983ebfc1c2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:51.305014 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1253/2494] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:52.983371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:53.051786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7060f1-3254-4e40-b703-9c5663bd0daa service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:53.056789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:53.057950 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:53.058318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:53.058676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] PATH_INFO: `/v3/users/c8f61f41d4aa4ab5afcfb43239ffb601` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:53.060145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f61f41d4aa4ab5afcfb43239ffb601)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:53.062636 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:53.131748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f61f41d4aa4ab5afcfb43239ffb601'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.138531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f61f41d4aa4ab5afcfb43239ffb601'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.139233 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f61f41d4aa4ab5afcfb43239ffb601'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.147014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f61f41d4aa4ab5afcfb43239ffb601'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.147788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f61f41d4aa4ab5afcfb43239ffb601'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.167125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1242/2495] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:52 2022] DELETE /identity/v3/users/c8f61f41d4aa4ab5afcfb43239ffb601 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:53.172163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:53.172655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:53.172897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:53.192535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:53.193949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:53.227752 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:53.256053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1254/2496] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:53.267100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:53.268530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:53.326714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a859-f3e8-43ab-adb4-c9cd36382f7d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:53.330795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:53.331473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:53.331758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:53.332049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:53.341526 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:53.343057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:53.352608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1243/2497] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:53.628658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:53.630371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:53.642586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a2565-cc7b-4010-9fab-8259db23e961 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:53.647542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:53.648409 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:53.648695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:53.648977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] PATH_INFO: `/v3/projects/c4f892dc77cc4cdbb1ec44d72487a947` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:53.650299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f892dc77cc4cdbb1ec44d72487a947)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:53.652216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:53.706057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f892dc77cc4cdbb1ec44d72487a947', 'request_id': 'req-629dbafb-d308-4e32-9bd7-930127834d5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.714137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f892dc77cc4cdbb1ec44d72487a947', 'request_id': 'req-629dbafb-d308-4e32-9bd7-930127834d5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.724164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f892dc77cc4cdbb1ec44d72487a947', 'request_id': 'req-629dbafb-d308-4e32-9bd7-930127834d5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.737020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] The token cache is being invalidate because project c4f892dc77cc4cdbb1ec44d72487a947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:53.737440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.738263 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.741848 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1255/2498] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:53 2022] DELETE /identity/v3/projects/c4f892dc77cc4cdbb1ec44d72487a947 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:53.745253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:53.755735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e07409-bcab-4a02-8b54-72d7d1e2b2c7 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:53.759715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:53.824873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:53.825786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:53.826074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:53.826355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] PATH_INFO: `/v3/users/6b79cf6d35c24fa1affb1adb7d808563` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:53.827606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b79cf6d35c24fa1affb1adb7d808563)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:53.829729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:53.890580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b79cf6d35c24fa1affb1adb7d808563'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.898349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b79cf6d35c24fa1affb1adb7d808563'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.899062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b79cf6d35c24fa1affb1adb7d808563'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.908085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b79cf6d35c24fa1affb1adb7d808563'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.909010 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbca4f49-63d6-41ef-a70b-6fcacad5ea3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b79cf6d35c24fa1affb1adb7d808563'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:53.928464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1244/2499] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:53 2022] DELETE /identity/v3/users/6b79cf6d35c24fa1affb1adb7d808563 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:54.320310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:54.321894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:54.348332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dbafb-d308-4e32-9bd7-930127834d5d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:54.410584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:54.411834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.412127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.412405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] PATH_INFO: `/v3/projects/e92c5cb27e8d43ec9d5a778f6bbaf598` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.413598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92c5cb27e8d43ec9d5a778f6bbaf598)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:54.415559 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:54.464485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92c5cb27e8d43ec9d5a778f6bbaf598', 'request_id': 'req-d7678c49-c5d1-41b8-b190-25a80157c9dc'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:54.472136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92c5cb27e8d43ec9d5a778f6bbaf598', 'request_id': 'req-d7678c49-c5d1-41b8-b190-25a80157c9dc'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:54.477774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:54.482132 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92c5cb27e8d43ec9d5a778f6bbaf598', 'request_id': 'req-d7678c49-c5d1-41b8-b190-25a80157c9dc'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:54.499626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] The token cache is being invalidate because project e92c5cb27e8d43ec9d5a778f6bbaf598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:54.499930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:54.500777 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d7678c49-c5d1-41b8-b190-25a80157c9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:54.502871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1256/2500] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:54 2022] DELETE /identity/v3/projects/e92c5cb27e8d43ec9d5a778f6bbaf598 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:03:54.508144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c6d6b-b871-4766-9bac-d6c9f0bc10dc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.508699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c6d6b-b871-4766-9bac-d6c9f0bc10dc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.508699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c6d6b-b871-4766-9bac-d6c9f0bc10dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.528161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-168c6d6b-b871-4766-9bac-d6c9f0bc10dc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:54.529385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-168c6d6b-b871-4766-9bac-d6c9f0bc10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:54.600005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1245/2501] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:54.607878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0be43-e3a5-4170-8284-8919ae71494a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.608823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0be43-e3a5-4170-8284-8919ae71494a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.609120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0be43-e3a5-4170-8284-8919ae71494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.631035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-04f0be43-e3a5-4170-8284-8919ae71494a None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:54.632244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-04f0be43-e3a5-4170-8284-8919ae71494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:54.641200 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1257/2502] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:03:54.645383 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c6d6b-b871-4766-9bac-d6c9f0bc10dc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:54.659030 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c6d6b-b871-4766-9bac-d6c9f0bc10dc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:54.664186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:54.664830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.665113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.665644 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.666187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:03:54.666544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:54.668590 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:54.683223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1246/2503] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:03:54.687658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0be43-e3a5-4170-8284-8919ae71494a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:54.697325 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0be43-e3a5-4170-8284-8919ae71494a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:54.702620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:54.703969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.704278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.704735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.705456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:54.708180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:54.739662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1258/2504] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:54 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:54.744026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:54.754289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2704a-66b6-4e5e-98d4-dad22729b493 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:54.764993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:54.835556 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:54.836250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.836684 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.836980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.837685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:54.839919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:54.866518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1247/2505] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:54 2022] POST /identity/v3/users => generated 280 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:54.870589 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:54.882213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ccf07-9d98-45d8-8925-ade93fb3b279 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:54.887125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:54.887809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.888098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.888390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.889171 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:54.890831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:54.905808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1259/2506] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:03:54.907539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:54.917988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07f26-e6f5-4f28-8e93-f60056ff7c45 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:54.928651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554cd48-dff5-45a0-90b0-ec5d089f6694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:54.929362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554cd48-dff5-45a0-90b0-ec5d089f6694 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.929708 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554cd48-dff5-45a0-90b0-ec5d089f6694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.930264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554cd48-dff5-45a0-90b0-ec5d089f6694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.931640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554cd48-dff5-45a0-90b0-ec5d089f6694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:54.933703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554cd48-dff5-45a0-90b0-ec5d089f6694 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:54.948686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1248/2507] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:54.950086 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:54.960451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bc165-b4cf-4478-aebc-de3ca0bcfc05 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:54.965131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:54.966036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:54.966321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:54.966603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] PATH_INFO: `/v3/projects/79d4f234f41347ae9340d1fb90cc9cd1/users/e613cfa04f174d6186607b50a2ec5309/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:54.981774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d4f234f41347ae9340d1fb90cc9cd1, user_id=e613cfa04f174d6186607b50a2ec5309, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:54.984450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:54.998764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1260/2508] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:54 2022] PUT /identity/v3/projects/79d4f234f41347ae9340d1fb90cc9cd1/users/e613cfa04f174d6186607b50a2ec5309/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:55.010094 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e742c-80f2-427a-bc61-e86bb1c96a23 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:55.010454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e742c-80f2-427a-bc61-e86bb1c96a23 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:55.010817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e742c-80f2-427a-bc61-e86bb1c96a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:55.041643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-061e742c-80f2-427a-bc61-e86bb1c96a23 None None] MFA Rules not processed for user `e613cfa04f174d6186607b50a2ec5309`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:55.042875 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-061e742c-80f2-427a-bc61-e86bb1c96a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:55.110484 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1249/2509] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:55 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:55.142324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:55.144152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:55.202556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015209-2c07-4a9f-a222-556eca926cb3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:55.206284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ae622-d9d6-4a5c-95be-f8553882a543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:55.206927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ae622-d9d6-4a5c-95be-f8553882a543 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:55.207214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ae622-d9d6-4a5c-95be-f8553882a543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:55.207497 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ae622-d9d6-4a5c-95be-f8553882a543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:55.215909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ae622-d9d6-4a5c-95be-f8553882a543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:55.217917 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ae622-d9d6-4a5c-95be-f8553882a543 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:55.226643 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1261/2510] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:55 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:55.244236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e742c-80f2-427a-bc61-e86bb1c96a23 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:55.309038 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e742c-80f2-427a-bc61-e86bb1c96a23 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:55.313593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:55.314508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:55.314795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:55.315072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] PATH_INFO: `/v3/users/e613cfa04f174d6186607b50a2ec5309` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:55.316288 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e613cfa04f174d6186607b50a2ec5309)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:55.318355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:55.341189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:55.368993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e613cfa04f174d6186607b50a2ec5309'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.378341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e613cfa04f174d6186607b50a2ec5309'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.382148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e613cfa04f174d6186607b50a2ec5309'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.395542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e613cfa04f174d6186607b50a2ec5309'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.396257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e613cfa04f174d6186607b50a2ec5309'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.414426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1250/2511] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:03:55 2022] DELETE /identity/v3/users/e613cfa04f174d6186607b50a2ec5309 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:55.419073 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:55.419504 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:55.419755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:55.436896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:55.438111 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:55.501130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1262/2512] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:55.510687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:55.512172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:55.571844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ced53-aa7b-47db-b10e-4f2785853fe1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:55.575847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372037b-eb2e-48f2-964a-bd33649b6453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:55.577534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372037b-eb2e-48f2-964a-bd33649b6453 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:55.577912 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372037b-eb2e-48f2-964a-bd33649b6453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:55.578202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372037b-eb2e-48f2-964a-bd33649b6453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:55.587735 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372037b-eb2e-48f2-964a-bd33649b6453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:55.589303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372037b-eb2e-48f2-964a-bd33649b6453 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:55.599375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1251/2513] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:03:55.862354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:55.863882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:55.878415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc6d7c-3c1d-49f5-9066-712b74d5bcc0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:55.883696 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:55.884575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:55.884865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:55.885147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] PATH_INFO: `/v3/projects/79d4f234f41347ae9340d1fb90cc9cd1` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:55.886425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d4f234f41347ae9340d1fb90cc9cd1)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:55.888410 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:55.920525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:55.938552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d4f234f41347ae9340d1fb90cc9cd1', 'request_id': 'req-6c57e1ff-6ea2-4059-8aed-5dc440eed489'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.943985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d4f234f41347ae9340d1fb90cc9cd1', 'request_id': 'req-6c57e1ff-6ea2-4059-8aed-5dc440eed489'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.950990 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d4f234f41347ae9340d1fb90cc9cd1', 'request_id': 'req-6c57e1ff-6ea2-4059-8aed-5dc440eed489'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.962468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] The token cache is being invalidate because project 79d4f234f41347ae9340d1fb90cc9cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:03:55.962775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.963397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6c57e1ff-6ea2-4059-8aed-5dc440eed489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:03:55.964962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1263/2514] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:03:55 2022] DELETE /identity/v3/projects/79d4f234f41347ae9340d1fb90cc9cd1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:03:55.969992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d304-d274-4b23-9528-2b18ed819bcc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:55.970293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d304-d274-4b23-9528-2b18ed819bcc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:55.970613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d304-d274-4b23-9528-2b18ed819bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:55.987703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0925d304-d274-4b23-9528-2b18ed819bcc None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:55.988892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0925d304-d274-4b23-9528-2b18ed819bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:56.046448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1252/2515] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:56.053967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f1992-9fb5-4022-9409-c8ca1ab20f99 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.054257 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f1992-9fb5-4022-9409-c8ca1ab20f99 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.054535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f1992-9fb5-4022-9409-c8ca1ab20f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.072766 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8c6f1992-9fb5-4022-9409-c8ca1ab20f99 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:56.073971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8c6f1992-9fb5-4022-9409-c8ca1ab20f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:56.081956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1264/2516] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:56.086053 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925d304-d274-4b23-9528-2b18ed819bcc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:56.096258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925d304-d274-4b23-9528-2b18ed819bcc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:56.100810 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:56.101456 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.101768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.102052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.102795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:03:56.103107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:56.104716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:56.116682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1253/2517] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:03:56.120686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f1992-9fb5-4022-9409-c8ca1ab20f99 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:56.129809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f1992-9fb5-4022-9409-c8ca1ab20f99 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:56.134431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:56.135081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.135373 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.135654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.136351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:56.138321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:56.164674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1265/2518] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:03:56 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:03:56.169097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:56.179229 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e8835-dfb1-43c5-9d1b-430adcba12f9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:56.208439 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:56.238461 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:56.239136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.239421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.239696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.240374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:56.242403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:56.265891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1254/2519] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:03:56 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:03:56.270063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:56.280416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0895e-5884-4240-84fa-2d833fedda59 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:56.285038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:56.285956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.286269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.286552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.287288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:56.288883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:56.299692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1266/2520] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:56.303546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:56.314864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7fbeb-088f-43b1-81d1-817329e440c8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:56.319992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aad566-a555-4838-9360-0b332d8c891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:56.320652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aad566-a555-4838-9360-0b332d8c891d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.320942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aad566-a555-4838-9360-0b332d8c891d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.321222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aad566-a555-4838-9360-0b332d8c891d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.321992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aad566-a555-4838-9360-0b332d8c891d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:56.323586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aad566-a555-4838-9360-0b332d8c891d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:56.334324 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1255/2521] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:03:56.338819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:56.348751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e244-066e-49d7-bc9b-323f19164188 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:56.353274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:56.354174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.354460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.354763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] PATH_INFO: `/v3/projects/182feb482f094cf39b6ddc04c6b13a17/users/fb7b5fa6247f480e8410d9a5f0b62aae/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.371144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=182feb482f094cf39b6ddc04c6b13a17, user_id=fb7b5fa6247f480e8410d9a5f0b62aae, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:56.374461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:56.389211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1267/2522] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:03:56 2022] PUT /identity/v3/projects/182feb482f094cf39b6ddc04c6b13a17/users/fb7b5fa6247f480e8410d9a5f0b62aae/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:03:56.399594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dddab2-33aa-477c-9e6c-f76ab7240d19 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.399889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dddab2-33aa-477c-9e6c-f76ab7240d19 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.400169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dddab2-33aa-477c-9e6c-f76ab7240d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.427428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a1dddab2-33aa-477c-9e6c-f76ab7240d19 None None] MFA Rules not processed for user `fb7b5fa6247f480e8410d9a5f0b62aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:03:56.428670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a1dddab2-33aa-477c-9e6c-f76ab7240d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:56.498026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1256/2523] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:03:56.510781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:03:56.514608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:03:56.580335 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65ed3-0f3c-4b9e-b316-4bd8bfcbf4db admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:03:56.584068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307ff9-4df7-4785-ac51-d13046cddc56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:03:56.584728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307ff9-4df7-4785-ac51-d13046cddc56 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:03:56.585017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307ff9-4df7-4785-ac51-d13046cddc56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:03:56.585313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307ff9-4df7-4785-ac51-d13046cddc56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:03:56.596962 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307ff9-4df7-4785-ac51-d13046cddc56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:03:56.598902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307ff9-4df7-4785-ac51-d13046cddc56 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:03:56.611208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1268/2524] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:03:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:04:06.391955 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dddab2-33aa-477c-9e6c-f76ab7240d19 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:06.453650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dddab2-33aa-477c-9e6c-f76ab7240d19 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:06.458254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:06.459121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:06.459401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:06.459674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] PATH_INFO: `/v3/users/fb7b5fa6247f480e8410d9a5f0b62aae` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:06.460851 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7b5fa6247f480e8410d9a5f0b62aae)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:06.462820 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:06.508035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:06.514042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7b5fa6247f480e8410d9a5f0b62aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:06.521974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7b5fa6247f480e8410d9a5f0b62aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:06.522660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7b5fa6247f480e8410d9a5f0b62aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:06.529989 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7b5fa6247f480e8410d9a5f0b62aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:06.530625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7b5fa6247f480e8410d9a5f0b62aae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:06.548358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1257/2525] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:04:06 2022] DELETE /identity/v3/users/fb7b5fa6247f480e8410d9a5f0b62aae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:04:06.553039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:06.553502 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:06.553599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:06.570230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:06.571625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:06.618954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:06.632161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1269/2526] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:04:06.642332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:06.643717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:06.699258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfb10a-0728-42fc-b8e6-0865af0e427e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:06.703475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb34ad-e8e6-49a5-93f8-2d7cef1dd156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:06.704120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb34ad-e8e6-49a5-93f8-2d7cef1dd156 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:06.704409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb34ad-e8e6-49a5-93f8-2d7cef1dd156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:06.704690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb34ad-e8e6-49a5-93f8-2d7cef1dd156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:06.713720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb34ad-e8e6-49a5-93f8-2d7cef1dd156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:06.715188 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb34ad-e8e6-49a5-93f8-2d7cef1dd156 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:06.725088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1258/2527] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:04:06.995170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:06.996602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:07.008387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c6ba0-0a9d-4573-a46f-3fe8b9e58097 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.013131 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.014567 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.014844 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.015168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] PATH_INFO: `/v3/projects/182feb482f094cf39b6ddc04c6b13a17` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.016736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182feb482f094cf39b6ddc04c6b13a17)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.018383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.065599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182feb482f094cf39b6ddc04c6b13a17', 'request_id': 'req-044b7126-e7af-498c-a782-c2e5974544a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:07.071210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182feb482f094cf39b6ddc04c6b13a17', 'request_id': 'req-044b7126-e7af-498c-a782-c2e5974544a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:07.079116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182feb482f094cf39b6ddc04c6b13a17', 'request_id': 'req-044b7126-e7af-498c-a782-c2e5974544a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:07.090521 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] The token cache is being invalidate because project 182feb482f094cf39b6ddc04c6b13a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:04:07.090811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:07.091440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-044b7126-e7af-498c-a782-c2e5974544a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:04:07.093003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1270/2528] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:04:06 2022] DELETE /identity/v3/projects/182feb482f094cf39b6ddc04c6b13a17 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:04:07.097982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d1e7-e98d-4f82-8824-ed52c95ca28b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.098280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d1e7-e98d-4f82-8824-ed52c95ca28b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.098563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d1e7-e98d-4f82-8824-ed52c95ca28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.115709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5a43d1e7-e98d-4f82-8824-ed52c95ca28b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:07.116908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5a43d1e7-e98d-4f82-8824-ed52c95ca28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:07.175146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1259/2529] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:04:07.234594 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3087-32d5-45b3-a18f-91104fb33582 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.234887 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3087-32d5-45b3-a18f-91104fb33582 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.235174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3087-32d5-45b3-a18f-91104fb33582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.253863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-33ff3087-32d5-45b3-a18f-91104fb33582 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:07.255049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-33ff3087-32d5-45b3-a18f-91104fb33582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:07.263012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1271/2530] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:04:07.267743 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d1e7-e98d-4f82-8824-ed52c95ca28b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:07.277527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d1e7-e98d-4f82-8824-ed52c95ca28b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.282889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.283543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.283834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.284119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.284844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:04:07.285156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.287042 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.298535 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1260/2531] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 10:04:07.302688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3087-32d5-45b3-a18f-91104fb33582 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:07.312272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3087-32d5-45b3-a18f-91104fb33582 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.316929 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.317570 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.317894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.318177 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.318865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.320755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.346607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1272/2532] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:04:07 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:04:07.351236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:07.366299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0c9d-a899-4ac1-8209-fe0ff1b2bebd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.411964 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:07.425015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.425732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.426005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.426287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.426976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.428889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.448400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1261/2533] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:04:07 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:04:07.452572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:07.462898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e21ab-50f5-4f3f-9b9d-5d4ed8be7d64 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.467543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.468196 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.468486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.468766 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.469544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.471187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.483113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1273/2534] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:04:07.486983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:07.496982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c7e75-31fe-4898-9dfc-07d2fac7a4e0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.502187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e2b97-f4db-404e-bf61-7608443fd3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.502866 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e2b97-f4db-404e-bf61-7608443fd3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.503155 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e2b97-f4db-404e-bf61-7608443fd3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.503438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e2b97-f4db-404e-bf61-7608443fd3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.504152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e2b97-f4db-404e-bf61-7608443fd3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.505769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e2b97-f4db-404e-bf61-7608443fd3d0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.515560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1262/2535] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:04:07.519430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:07.529480 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d42b9-2dfa-4232-b2e9-80bb9783907d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.534286 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.535161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.535451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.535734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] PATH_INFO: `/v3/projects/0ddc37afc4d54ccab945af619507a613/users/1d75851094d145f4907c7049d78dafed/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.551640 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddc37afc4d54ccab945af619507a613, user_id=1d75851094d145f4907c7049d78dafed, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.554342 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.569427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1274/2536] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:04:07 2022] PUT /identity/v3/projects/0ddc37afc4d54ccab945af619507a613/users/1d75851094d145f4907c7049d78dafed/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:04:07.574746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bc166-5c20-4c3c-b5d0-5e819e006cc5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.575205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bc166-5c20-4c3c-b5d0-5e819e006cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.575492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bc166-5c20-4c3c-b5d0-5e819e006cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.593336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-972bc166-5c20-4c3c-b5d0-5e819e006cc5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:07.594572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-972bc166-5c20-4c3c-b5d0-5e819e006cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:07.655150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1263/2537] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:04:07.665115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:07.666835 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:07.728403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1c2b4-7d14-4eb2-b116-1fc9f58ab1eb admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:07.732081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:07.733250 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:07.733532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:07.733869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:07.743302 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:07.744751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:07.754992 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1275/2538] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:04:08.382400 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa123a7a-3f83-4099-859b-efb84125d5a5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:08.382697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa123a7a-3f83-4099-859b-efb84125d5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:08.382987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa123a7a-3f83-4099-859b-efb84125d5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:08.411872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-aa123a7a-3f83-4099-859b-efb84125d5a5 None None] MFA Rules not processed for user `1d75851094d145f4907c7049d78dafed`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:08.413092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aa123a7a-3f83-4099-859b-efb84125d5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:08.490204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1264/2539] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:04:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:04:08.501680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:08.503115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:08.521395 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:08.564423 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323d2c4-678f-417b-9847-95024e31e214 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:08.568154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a456e4-4049-4094-bb02-227c817d5616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:08.568829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a456e4-4049-4094-bb02-227c817d5616 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:08.569091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a456e4-4049-4094-bb02-227c817d5616 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:08.569374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a456e4-4049-4094-bb02-227c817d5616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:08.578740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a456e4-4049-4094-bb02-227c817d5616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:08.580283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a456e4-4049-4094-bb02-227c817d5616 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:08.590056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1276/2540] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:04:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 10:04:09.953373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:09.953959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:09.953959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:09.971302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] MFA Rules not processed for user `1d75851094d145f4907c7049d78dafed`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:09.972515 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:09.979573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1265/2541] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:04:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:04:18.585465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=19 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:19.965886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:25.262558 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475854-9e7d-4e33-b54e-179b07291490 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:25.263072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475854-9e7d-4e33-b54e-179b07291490 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:25.263176 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475854-9e7d-4e33-b54e-179b07291490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:25.281604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5c475854-9e7d-4e33-b54e-179b07291490 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:25.282829 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5c475854-9e7d-4e33-b54e-179b07291490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:25.340872 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1277/2542] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 10:04:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:04:25.387485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:25.389402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:25.459268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8e30b-533e-4a7c-9107-9741093991d0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:25.464252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ebf64-3232-4278-97c6-d6165c7cb0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:25.464905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ebf64-3232-4278-97c6-d6165c7cb0e9 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:25.465196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ebf64-3232-4278-97c6-d6165c7cb0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:25.465482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ebf64-3232-4278-97c6-d6165c7cb0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:25.474152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ebf64-3232-4278-97c6-d6165c7cb0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:25.475758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ebf64-3232-4278-97c6-d6165c7cb0e9 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:25.483758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1266/2543] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:04:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:04:32.574421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f586f-1c63-45b5-8940-83ebe39be667 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:32.575002 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f586f-1c63-45b5-8940-83ebe39be667 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:32.575239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f586f-1c63-45b5-8940-83ebe39be667 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:32.577219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1278/2544] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 10:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 10:04:32.583727 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec014e-7114-49ee-9b82-6ab1255f36c8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:32.584615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec014e-7114-49ee-9b82-6ab1255f36c8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:32.584901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec014e-7114-49ee-9b82-6ab1255f36c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:32.609780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4fec014e-7114-49ee-9b82-6ab1255f36c8 None None] MFA Rules not processed for user `2585af8b95ea48d1a3576bd722536fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:32.611653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4fec014e-7114-49ee-9b82-6ab1255f36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:32.619645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1267/2545] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:04:32.634170 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f586f-1c63-45b5-8940-83ebe39be667 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:32.659768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f586f-1c63-45b5-8940-83ebe39be667 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:32.664343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77e234-ee36-4f4f-901f-09c2504501c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:32.665191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e234-ee36-4f4f-901f-09c2504501c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:32.665649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e234-ee36-4f4f-901f-09c2504501c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:32.666005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e234-ee36-4f4f-901f-09c2504501c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:32.677785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77e234-ee36-4f4f-901f-09c2504501c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:32.680612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77e234-ee36-4f4f-901f-09c2504501c8 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:32.691284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1279/2546] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:04:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:04:32.811316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48b2e-cc0e-4571-a092-86569a4970a5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:32.811612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48b2e-cc0e-4571-a092-86569a4970a5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:32.811903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48b2e-cc0e-4571-a092-86569a4970a5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:32.813893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1268/2547] 10.222.0.45 () {54 vars in 921 bytes} [Fri Jun 3 10:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 10:04:32.819698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150361c-f7b9-4489-9c8c-9deb629e988a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:32.819989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150361c-f7b9-4489-9c8c-9deb629e988a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:32.820268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150361c-f7b9-4489-9c8c-9deb629e988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:32.843142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9150361c-f7b9-4489-9c8c-9deb629e988a None None] MFA Rules not processed for user `d89ce6057b2843f2bfbc5a143eb9300e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:32.844440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9150361c-f7b9-4489-9c8c-9deb629e988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:32.939255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1280/2548] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Jun 3 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:04:32.950161 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d48b2e-cc0e-4571-a092-86569a4970a5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:32.963221 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d48b2e-cc0e-4571-a092-86569a4970a5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:32.966968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:32.967606 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:32.967885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:32.968194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:32.981366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:32.983426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:33.001217 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1269/2549] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:04:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 10:04:42.927152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=62 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:42.990895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=41 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:43.510597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:43.510891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:43.511179 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:43.528425 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:04:43.529602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:04:43.536895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1281/2550] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:04:43.549020 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:04:43.560096 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62762a5-d7e9-4505-a4e2-8570eeb2e168 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:04:43.565542 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e875389-4207-4efd-8690-03d20d3b4b0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:04:43.566216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e875389-4207-4efd-8690-03d20d3b4b0d service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:04:43.566508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e875389-4207-4efd-8690-03d20d3b4b0d service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:04:43.566792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e875389-4207-4efd-8690-03d20d3b4b0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:04:43.574765 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e875389-4207-4efd-8690-03d20d3b4b0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:04:43.576352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e875389-4207-4efd-8690-03d20d3b4b0d service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:04:43.584470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1270/2551] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:04:53.523195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:53.581015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:00.146211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:00.147682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:00.218000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4476286-8eb2-4b82-8f8d-7f17b73c828c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:00.223669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:00.224312 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:00.224601 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:00.224883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:00.226665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:00.238396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:00.239978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:00.249626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1282/2552] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:10.245494 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=32 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:12.028695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:12.029190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:12.029295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:12.047982 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:12.049924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:12.056961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1271/2553] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 3 10:05:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:12.069050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:12.080483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37409caf-4689-4a33-b27a-09b5b82752e9 service placement] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:12.088181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bf12-c18a-4982-ba1d-c2512b18ebf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:12.088181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bf12-c18a-4982-ba1d-c2512b18ebf7 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:12.088181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bf12-c18a-4982-ba1d-c2512b18ebf7 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:12.088181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bf12-c18a-4982-ba1d-c2512b18ebf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:12.096525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bf12-c18a-4982-ba1d-c2512b18ebf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:12.098156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bf12-c18a-4982-ba1d-c2512b18ebf7 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:12.106817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1283/2554] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:05:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:22.042202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:22.103143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:28.244029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:28.245440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:28.257307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4d73-cbb2-47b8-9e9f-d0d6b1b7f172 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:28.260855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:28.261492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:28.261802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:28.262086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:28.263796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:28.320705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:28.322097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:28.330862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1272/2555] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:30.108936 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c569a-c3aa-4ae7-ab8c-125715b39a3a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:30.109460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c569a-c3aa-4ae7-ab8c-125715b39a3a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:30.109590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c569a-c3aa-4ae7-ab8c-125715b39a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:30.127295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cf8c569a-c3aa-4ae7-ab8c-125715b39a3a None None] MFA Rules not processed for user `1d75851094d145f4907c7049d78dafed`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:30.128483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cf8c569a-c3aa-4ae7-ab8c-125715b39a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:30.135911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1284/2556] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:37.132120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:37.133600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:37.146149 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263af5b-eb3b-4ca5-bbd2-1fbff2955878 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:37.149729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:37.150405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:37.150690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:37.150966 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:37.152698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:37.165572 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:37.167114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:37.183035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1273/2557] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:37.284564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace69135-50a2-4786-8251-0983d31f2e97 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:37.285129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace69135-50a2-4786-8251-0983d31f2e97 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:37.285129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace69135-50a2-4786-8251-0983d31f2e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:37.303658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ace69135-50a2-4786-8251-0983d31f2e97 None None] MFA Rules not processed for user `397ff11fedcc4d17867e1d9c10fcd10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:37.304861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ace69135-50a2-4786-8251-0983d31f2e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:37.312252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1285/2558] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:41.337891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:41.341089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:41.358865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a7ea4-f049-497f-8a6c-58daebf88b55 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:41.363871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:41.365440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:41.365872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:41.366493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] PATH_INFO: `/v3/users/e62d9d781281497e9927c0eb0e85dd75` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:41.368376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62d9d781281497e9927c0eb0e85dd75)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:41.370888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:41.434868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62d9d781281497e9927c0eb0e85dd75'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.444247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62d9d781281497e9927c0eb0e85dd75'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.445061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62d9d781281497e9927c0eb0e85dd75'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.456009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62d9d781281497e9927c0eb0e85dd75'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.456688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8642506e-1906-4652-85de-8537563a0572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62d9d781281497e9927c0eb0e85dd75'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.482296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1274/2559] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:05:41 2022] DELETE /identity/v3/users/e62d9d781281497e9927c0eb0e85dd75 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:41.716916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace69135-50a2-4786-8251-0983d31f2e97 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:41.735907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace69135-50a2-4786-8251-0983d31f2e97 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:41.821030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:41.822192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:41.822629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:41.823055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] PATH_INFO: `/v3/projects/12d4ca628b894615bc311c3705c4a801` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:41.824505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d4ca628b894615bc311c3705c4a801)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:41.828371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:41.894466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d4ca628b894615bc311c3705c4a801', 'request_id': 'req-9386b3c6-05fc-49a0-9495-358558da9f74'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.902387 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d4ca628b894615bc311c3705c4a801', 'request_id': 'req-9386b3c6-05fc-49a0-9495-358558da9f74'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.919773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d4ca628b894615bc311c3705c4a801', 'request_id': 'req-9386b3c6-05fc-49a0-9495-358558da9f74'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.938203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] The token cache is being invalidate because project 12d4ca628b894615bc311c3705c4a801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:05:41.938633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.939198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9386b3c6-05fc-49a0-9495-358558da9f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:41.941725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1286/2560] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:05:41 2022] DELETE /identity/v3/projects/12d4ca628b894615bc311c3705c4a801 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:41.951230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc842d-9a06-49d4-9e4e-140036f35858 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:41.951582 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc842d-9a06-49d4-9e4e-140036f35858 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:41.951872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc842d-9a06-49d4-9e4e-140036f35858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:41.975014 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9fbc842d-9a06-49d4-9e4e-140036f35858 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:41.976286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9fbc842d-9a06-49d4-9e4e-140036f35858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:42.033847 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:42.047449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1275/2561] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:42.055331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f1db5-cd67-4435-9cff-00dd27ace5bf None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.055633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f1db5-cd67-4435-9cff-00dd27ace5bf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.055920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f1db5-cd67-4435-9cff-00dd27ace5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.077198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b25f1db5-cd67-4435-9cff-00dd27ace5bf None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:42.078919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b25f1db5-cd67-4435-9cff-00dd27ace5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:42.087882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1287/2562] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:42.092179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc842d-9a06-49d4-9e4e-140036f35858 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:42.104489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc842d-9a06-49d4-9e4e-140036f35858 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:42.110333 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:42.111024 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.111314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.111600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.112341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:05:42.112658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:42.115179 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:42.129075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1276/2563] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:05:42.133115 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f1db5-cd67-4435-9cff-00dd27ace5bf None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:42.144692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f1db5-cd67-4435-9cff-00dd27ace5bf None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:42.150580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:42.151333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.151696 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.152053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.152831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:42.155039 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:42.188748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1288/2564] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:05:42 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:42.194134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:42.205187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de58383-8a2c-4d66-b3b5-c17aee38dbfe admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:42.280757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:42.281452 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.282326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.282326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.283334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:42.285304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:42.317934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1277/2565] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:05:42 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:42.319720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:42.333984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e01f4-efa6-49c2-b5e7-d5849a0374a0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:42.342540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:42.344698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.345332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.345617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.346490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:42.351750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:42.364542 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1289/2566] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:42.368625 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:42.378733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63ffc-c484-4e70-9620-ad7539898051 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:42.383747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376ac2b-aaf8-4513-91bb-b04ed9317aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:42.384423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ac2b-aaf8-4513-91bb-b04ed9317aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.384714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ac2b-aaf8-4513-91bb-b04ed9317aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.384996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ac2b-aaf8-4513-91bb-b04ed9317aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.385728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ac2b-aaf8-4513-91bb-b04ed9317aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:42.389876 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ac2b-aaf8-4513-91bb-b04ed9317aa1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:42.399692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1278/2567] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:42.404058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:42.415025 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9137-b234-4841-9e2d-e79acafef285 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:42.420517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:42.421406 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.421915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.422208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] PATH_INFO: `/v3/projects/c0415f4f2ec04dc5b07aafaa2f23139d/users/1d4732a30f464874b89d2d28f79174b9/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.438598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0415f4f2ec04dc5b07aafaa2f23139d, user_id=1d4732a30f464874b89d2d28f79174b9, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:42.441473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:42.455840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1290/2568] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:05:42 2022] PUT /identity/v3/projects/c0415f4f2ec04dc5b07aafaa2f23139d/users/1d4732a30f464874b89d2d28f79174b9/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:05:42.466335 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a0d7-dc42-4c80-978d-34bc2aa77a91 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.466632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a0d7-dc42-4c80-978d-34bc2aa77a91 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.467103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a0d7-dc42-4c80-978d-34bc2aa77a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.513156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e291a0d7-dc42-4c80-978d-34bc2aa77a91 None None] MFA Rules not processed for user `1d4732a30f464874b89d2d28f79174b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:42.514391 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e291a0d7-dc42-4c80-978d-34bc2aa77a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:42.583672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1279/2569] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:42.594381 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:42.596293 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:42.615457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:42.669973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7e45a-4f4c-42a4-8c35-75c2744838b8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:42.673707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49ee51-00e0-4535-a80d-a3d3d4f33cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:42.674390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ee51-00e0-4535-a80d-a3d3d4f33cfb service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:42.674681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ee51-00e0-4535-a80d-a3d3d4f33cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:42.674966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ee51-00e0-4535-a80d-a3d3d4f33cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:42.683790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49ee51-00e0-4535-a80d-a3d3d4f33cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:42.685243 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49ee51-00e0-4535-a80d-a3d3d4f33cfb service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:42.696985 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1291/2570] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:51.025180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a0d7-dc42-4c80-978d-34bc2aa77a91 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:51.075332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:51.087517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a0d7-dc42-4c80-978d-34bc2aa77a91 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:51.091979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:51.092839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.093123 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.093399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] PATH_INFO: `/v3/users/1d4732a30f464874b89d2d28f79174b9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.094620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4732a30f464874b89d2d28f79174b9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:51.096528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:51.140692 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4732a30f464874b89d2d28f79174b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.147614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4732a30f464874b89d2d28f79174b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.148313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4732a30f464874b89d2d28f79174b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.154726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4732a30f464874b89d2d28f79174b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.155431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4732a30f464874b89d2d28f79174b9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.172425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1280/2571] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:05:51 2022] DELETE /identity/v3/users/1d4732a30f464874b89d2d28f79174b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:51.177496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.178004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.178103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.195446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:51.196641 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:51.254009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1292/2572] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:51.263992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:51.265395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:51.332504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6f4a-aefb-4749-bdbc-4c2c8190a544 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:51.336176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f958780-4cc5-4dc5-b6ad-ffcc1c44d135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:51.336816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958780-4cc5-4dc5-b6ad-ffcc1c44d135 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.337099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958780-4cc5-4dc5-b6ad-ffcc1c44d135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.337377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958780-4cc5-4dc5-b6ad-ffcc1c44d135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.346450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f958780-4cc5-4dc5-b6ad-ffcc1c44d135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:51.347894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f958780-4cc5-4dc5-b6ad-ffcc1c44d135 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:51.357375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1281/2573] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:51.630740 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:51.632160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:51.646707 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460478d8-bb0c-4225-a1bb-7f205f8d7764 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:51.651466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:51.652445 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.652739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.653018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] PATH_INFO: `/v3/projects/c0415f4f2ec04dc5b07aafaa2f23139d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.654268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0415f4f2ec04dc5b07aafaa2f23139d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:51.656186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:51.704586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0415f4f2ec04dc5b07aafaa2f23139d', 'request_id': 'req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.710432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0415f4f2ec04dc5b07aafaa2f23139d', 'request_id': 'req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.717462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0415f4f2ec04dc5b07aafaa2f23139d', 'request_id': 'req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.729883 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] The token cache is being invalidate because project c0415f4f2ec04dc5b07aafaa2f23139d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:05:51.730174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.730820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-426d0660-b4b8-4f4e-a5b0-71421ea4fb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:51.732351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1293/2574] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:05:51 2022] DELETE /identity/v3/projects/c0415f4f2ec04dc5b07aafaa2f23139d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:51.737128 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf11e-e3fb-461a-b0a8-7c21a8fc53b6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.737417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf11e-e3fb-461a-b0a8-7c21a8fc53b6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.737801 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf11e-e3fb-461a-b0a8-7c21a8fc53b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.755290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2eccf11e-e3fb-461a-b0a8-7c21a8fc53b6 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:51.756405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2eccf11e-e3fb-461a-b0a8-7c21a8fc53b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:51.815287 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1282/2575] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:05:51.823055 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cba46d-ec9e-4509-94bc-dcd1d20f938f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.823353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cba46d-ec9e-4509-94bc-dcd1d20f938f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.823635 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cba46d-ec9e-4509-94bc-dcd1d20f938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.841983 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-18cba46d-ec9e-4509-94bc-dcd1d20f938f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:51.843190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-18cba46d-ec9e-4509-94bc-dcd1d20f938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:51.851701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1294/2576] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:51.855945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf11e-e3fb-461a-b0a8-7c21a8fc53b6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:51.866753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf11e-e3fb-461a-b0a8-7c21a8fc53b6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:51.871351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:51.872017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.872307 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.872588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.873310 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:05:51.873622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:51.875278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:51.887444 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1283/2577] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:05:51.891658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cba46d-ec9e-4509-94bc-dcd1d20f938f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:51.901586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cba46d-ec9e-4509-94bc-dcd1d20f938f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:51.906323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:51.906965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:51.907247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:51.907524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:51.908278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:51.910211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:51.936079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1295/2578] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:05:51 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:51.940207 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:51.945455 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:51.951569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef93b-1924-4ac9-8cb3-0260455cf5dd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.009533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.010171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.010463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.010748 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.011440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.013373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.032494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1284/2579] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:05:51 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:52.037125 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.047675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2cc5b-d153-488b-892e-179c35c34a30 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.052261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.052913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.053201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.053483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.054317 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.055941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.061141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:52.067030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1296/2580] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:52.070849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.080669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91b970-3066-4bed-aa92-5c20733f1c6e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.085911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a74063-fbac-449c-9a12-1d941e23d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.086564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a74063-fbac-449c-9a12-1d941e23d601 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.086854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a74063-fbac-449c-9a12-1d941e23d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.087135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a74063-fbac-449c-9a12-1d941e23d601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.087856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a74063-fbac-449c-9a12-1d941e23d601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.089448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a74063-fbac-449c-9a12-1d941e23d601 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.099778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1285/2581] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:52.103663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.113253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef6394-269c-4cdf-bd79-d2f9fa94b153 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.117857 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.118718 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.119006 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.119283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] PATH_INFO: `/v3/projects/3ee60418407441488ea1107975c15dd4/users/5635a72518334ecd88fa7302e52f9ef5/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.133664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee60418407441488ea1107975c15dd4, user_id=5635a72518334ecd88fa7302e52f9ef5, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.136309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.149674 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1297/2582] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:05:52 2022] PUT /identity/v3/projects/3ee60418407441488ea1107975c15dd4/users/5635a72518334ecd88fa7302e52f9ef5/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:52.161501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c29c-4b58-4d96-9fbb-b7bff422b378 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.161828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c29c-4b58-4d96-9fbb-b7bff422b378 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.162113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c29c-4b58-4d96-9fbb-b7bff422b378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.188261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e9b1c29c-4b58-4d96-9fbb-b7bff422b378 None None] MFA Rules not processed for user `5635a72518334ecd88fa7302e52f9ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:52.189469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e9b1c29c-4b58-4d96-9fbb-b7bff422b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:52.251364 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1286/2583] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:52.256292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.318435 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b597191-bc30-43c3-b42a-2093063a267a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.322977 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.323626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.323913 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.324195 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.324882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.326858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.355215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1298/2584] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:05:52 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:52.359227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c29c-4b58-4d96-9fbb-b7bff422b378 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.370432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c29c-4b58-4d96-9fbb-b7bff422b378 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.425979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.427257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.427547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.427830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.428522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.430492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.445133 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:52.451001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1287/2585] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:05:52 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:52.454652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.464700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768fb7-95c4-4c1f-9bae-d2095abbfaf8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.469320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.470003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.470296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.470578 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.471301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.472900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.483824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1299/2586] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:52.487730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.497987 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91812179-b8ea-4a6e-bba8-0dc9b1422679 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.502629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.503504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.503788 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.504070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] PATH_INFO: `/v3/projects/b19f34a893e54168981106b3f555b33f/users/fd5638ad2ce34125b2eb7dbc8a0ec9a0/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.518949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19f34a893e54168981106b3f555b33f, user_id=fd5638ad2ce34125b2eb7dbc8a0ec9a0, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.521728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.534352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1288/2587] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:05:52 2022] PUT /identity/v3/projects/b19f34a893e54168981106b3f555b33f/users/fd5638ad2ce34125b2eb7dbc8a0ec9a0/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:05:52.539178 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.548900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ebb42-bf13-4b76-b788-7b1590ec6ee7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.606882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53168c8f-8513-4337-8145-b73ef086fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.607459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168c8f-8513-4337-8145-b73ef086fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.607746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168c8f-8513-4337-8145-b73ef086fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.608027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168c8f-8513-4337-8145-b73ef086fae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.608762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53168c8f-8513-4337-8145-b73ef086fae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.610412 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53168c8f-8513-4337-8145-b73ef086fae4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.621139 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1300/2588] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:52.625261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.635389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442a02-5fa8-43e0-9c50-3e5f4124dc36 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.640018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.640894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.641181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.641462 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] PATH_INFO: `/v3/projects/b19f34a893e54168981106b3f555b33f/users/fd5638ad2ce34125b2eb7dbc8a0ec9a0/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.643467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19f34a893e54168981106b3f555b33f, user_id=fd5638ad2ce34125b2eb7dbc8a0ec9a0, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.646659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.656597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1289/2589] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:05:52 2022] PUT /identity/v3/projects/b19f34a893e54168981106b3f555b33f/users/fd5638ad2ce34125b2eb7dbc8a0ec9a0/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:52.667230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8dc8-1017-4670-baa6-c15205f0efe6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.667524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8dc8-1017-4670-baa6-c15205f0efe6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.667814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8dc8-1017-4670-baa6-c15205f0efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.694799 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3b8c8dc8-1017-4670-baa6-c15205f0efe6 None None] MFA Rules not processed for user `fd5638ad2ce34125b2eb7dbc8a0ec9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:52.696018 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3b8c8dc8-1017-4670-baa6-c15205f0efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:52.731547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:52.766101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1301/2590] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:52.777706 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:52.779497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:52.835635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ef71-32cb-46fb-bec6-1f70b3a7662f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:52.839258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790ef6-50a8-4d64-aaf6-27747321ec65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:52.839901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790ef6-50a8-4d64-aaf6-27747321ec65 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:52.840189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790ef6-50a8-4d64-aaf6-27747321ec65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:52.840471 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790ef6-50a8-4d64-aaf6-27747321ec65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:52.850063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790ef6-50a8-4d64-aaf6-27747321ec65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:52.851504 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790ef6-50a8-4d64-aaf6-27747321ec65 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:52.860804 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1290/2591] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:53.289944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8dc8-1017-4670-baa6-c15205f0efe6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:53.349907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8dc8-1017-4670-baa6-c15205f0efe6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:53.354365 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:53.355227 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:53.355513 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:53.355790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] PATH_INFO: `/v3/users/5635a72518334ecd88fa7302e52f9ef5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:53.356961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5635a72518334ecd88fa7302e52f9ef5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:53.358925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:53.407260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5635a72518334ecd88fa7302e52f9ef5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.414353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5635a72518334ecd88fa7302e52f9ef5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.415003 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5635a72518334ecd88fa7302e52f9ef5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.421871 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5635a72518334ecd88fa7302e52f9ef5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.422464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5635a72518334ecd88fa7302e52f9ef5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.440024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1302/2592] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:05:53 2022] DELETE /identity/v3/users/5635a72518334ecd88fa7302e52f9ef5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:53.445018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:53.445525 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:53.445661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:53.462685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:53.463872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:53.521327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1291/2593] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:53.531015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:53.532534 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:53.589048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4add41-91f6-4fba-8122-8bc52ade4c44 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:53.592664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:53.593299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:53.593582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:53.593896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:53.599660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:53.604190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:53.606238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:53.616815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1303/2594] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:53.885738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:53.887205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:53.899902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4321-e8f6-4221-bb6c-8e664dd70498 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:53.904751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:53.905655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:53.906032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:53.906321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] PATH_INFO: `/v3/projects/3ee60418407441488ea1107975c15dd4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:53.907779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee60418407441488ea1107975c15dd4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:53.910213 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:53.958429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee60418407441488ea1107975c15dd4', 'request_id': 'req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.966088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee60418407441488ea1107975c15dd4', 'request_id': 'req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.971181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:53.972798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee60418407441488ea1107975c15dd4', 'request_id': 'req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.987397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] The token cache is being invalidate because project 3ee60418407441488ea1107975c15dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:05:53.987721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.988338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:53.989915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1292/2595] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:05:53 2022] DELETE /identity/v3/projects/3ee60418407441488ea1107975c15dd4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:53.994004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:54.003892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dff0a-500b-4434-b91f-b1d724e2fe9c service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:54.066486 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:54.067625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:54.067916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:54.068213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] PATH_INFO: `/v3/users/fd5638ad2ce34125b2eb7dbc8a0ec9a0` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:54.069408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5638ad2ce34125b2eb7dbc8a0ec9a0)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:54.071383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:54.122587 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5638ad2ce34125b2eb7dbc8a0ec9a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.134606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5638ad2ce34125b2eb7dbc8a0ec9a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.135235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5638ad2ce34125b2eb7dbc8a0ec9a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.144717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5638ad2ce34125b2eb7dbc8a0ec9a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.145509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5814963b-b045-4bc9-8390-9292dd9f086d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5638ad2ce34125b2eb7dbc8a0ec9a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.168784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1304/2596] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:05:53 2022] DELETE /identity/v3/users/fd5638ad2ce34125b2eb7dbc8a0ec9a0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:54.727496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:54.729558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:54.745302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaa370-9a0d-4cc1-bd58-843c662dbbb2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:54.806344 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:54.807252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:54.807537 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:54.807814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] PATH_INFO: `/v3/projects/b19f34a893e54168981106b3f555b33f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:54.808978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19f34a893e54168981106b3f555b33f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:54.810907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:54.855978 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19f34a893e54168981106b3f555b33f', 'request_id': 'req-bb101b42-9c2c-4912-8143-07447a2510af'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.861996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19f34a893e54168981106b3f555b33f', 'request_id': 'req-bb101b42-9c2c-4912-8143-07447a2510af'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.868610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19f34a893e54168981106b3f555b33f', 'request_id': 'req-bb101b42-9c2c-4912-8143-07447a2510af'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.884878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] The token cache is being invalidate because project b19f34a893e54168981106b3f555b33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:05:54.885169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.885867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bb101b42-9c2c-4912-8143-07447a2510af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:05:54.887407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1293/2597] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:05:54 2022] DELETE /identity/v3/projects/b19f34a893e54168981106b3f555b33f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:54.892307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b59db-535e-400d-a3bb-9e5c6002d3c9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:54.892803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b59db-535e-400d-a3bb-9e5c6002d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:54.892914 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b59db-535e-400d-a3bb-9e5c6002d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:54.912654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b00b59db-535e-400d-a3bb-9e5c6002d3c9 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:54.913916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b00b59db-535e-400d-a3bb-9e5c6002d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:54.970673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1305/2598] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:54.978919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585286-caa1-4cbe-9fc3-5ff9285706a5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:54.979211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585286-caa1-4cbe-9fc3-5ff9285706a5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:54.979500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585286-caa1-4cbe-9fc3-5ff9285706a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:54.997611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fd585286-caa1-4cbe-9fc3-5ff9285706a5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:54.998842 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fd585286-caa1-4cbe-9fc3-5ff9285706a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:55.007086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1294/2599] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:55.012261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b59db-535e-400d-a3bb-9e5c6002d3c9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.023211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b59db-535e-400d-a3bb-9e5c6002d3c9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.027934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.028593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.028906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.029188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.029976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:05:55.030290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.031927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.041490 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.046746 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1306/2600] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:05:55.050620 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585286-caa1-4cbe-9fc3-5ff9285706a5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.060442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585286-caa1-4cbe-9fc3-5ff9285706a5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.065154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.065830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.066647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.066647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.067109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.069007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.094723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1295/2601] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:05:55 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:55.099712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.109596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489e574-a59c-421e-a3a5-65b737c4a303 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.173669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.174297 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.174582 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.174863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.175595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.181416 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.201796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1307/2602] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:05:55 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:55.204539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.215750 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922331b7-f864-4514-8ab4-6df0ea07476c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.220806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.221445 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.221730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.222048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.222792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.225056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.237567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1296/2603] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:55.241658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.251547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b5689-8cdb-4cf4-93e3-27a154557d08 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.256747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbb137-8743-44d5-b39f-b5d1ebf34fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.257401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbb137-8743-44d5-b39f-b5d1ebf34fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.257692 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbb137-8743-44d5-b39f-b5d1ebf34fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.258011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbb137-8743-44d5-b39f-b5d1ebf34fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.258736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbb137-8743-44d5-b39f-b5d1ebf34fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.260340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbb137-8743-44d5-b39f-b5d1ebf34fe3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.271429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1308/2604] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:05:55.275609 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.287166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6044d-e8ae-4aab-880d-2806942998b0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.292351 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.293244 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.293516 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.293837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] PATH_INFO: `/v3/projects/6706f3eba6df49f39f7beea68754e6dd/users/589dea66480743f2853b0969080b3e35/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.309145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6706f3eba6df49f39f7beea68754e6dd, user_id=589dea66480743f2853b0969080b3e35, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.312006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.332118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1297/2605] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:05:55 2022] PUT /identity/v3/projects/6706f3eba6df49f39f7beea68754e6dd/users/589dea66480743f2853b0969080b3e35/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:05:55.343591 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3c93-b95c-4929-8a8d-a97d84834182 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.343881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3c93-b95c-4929-8a8d-a97d84834182 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.344159 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3c93-b95c-4929-8a8d-a97d84834182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.371733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-803e3c93-b95c-4929-8a8d-a97d84834182 None None] MFA Rules not processed for user `589dea66480743f2853b0969080b3e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:55.372952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-803e3c93-b95c-4929-8a8d-a97d84834182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:55.440951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1309/2606] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:55.445651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.463469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.507970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a8ab-318d-455c-b109-9d6fc957c185 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.513249 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.513949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.514240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.514523 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.515204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.517191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.542194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1298/2607] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:05:55 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:55.546332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3c93-b95c-4929-8a8d-a97d84834182 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.558147 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3c93-b95c-4929-8a8d-a97d84834182 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.616027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.616696 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.616987 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.617269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.618012 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.619961 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.634050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.640828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1310/2608] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:05:55 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:05:55.644699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.657571 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e54649-7c3c-4196-bb82-994588218181 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.662869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.663540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.663826 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.664107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.664853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.666473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.677664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1299/2609] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:05:55.681772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.691547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b3267-369a-4339-ac21-85af74cd1240 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.696747 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.697613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.697938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.698216 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] PATH_INFO: `/v3/projects/32615f90d5664174ac0e2f417ae3dae2/users/ea2faca4533646dc979bdddcc2c32ea2/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.712403 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32615f90d5664174ac0e2f417ae3dae2, user_id=ea2faca4533646dc979bdddcc2c32ea2, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.715051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.727511 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1311/2610] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:05:55 2022] PUT /identity/v3/projects/32615f90d5664174ac0e2f417ae3dae2/users/ea2faca4533646dc979bdddcc2c32ea2/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:05:55.731410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.741928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7406c9-8667-408d-bd2e-438c9a48ef5a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.796482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e6fdc-04c7-42cf-bdc0-bb1bdf61f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.797074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e6fdc-04c7-42cf-bdc0-bb1bdf61f793 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.797365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e6fdc-04c7-42cf-bdc0-bb1bdf61f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.797653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e6fdc-04c7-42cf-bdc0-bb1bdf61f793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.798397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e6fdc-04c7-42cf-bdc0-bb1bdf61f793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.799990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e6fdc-04c7-42cf-bdc0-bb1bdf61f793 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.810494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1300/2611] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:05:55.814763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.826034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64858b36-9aec-4e50-8c1b-bf075975ac36 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:55.830721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:55.831625 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.831909 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.832184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] PATH_INFO: `/v3/projects/32615f90d5664174ac0e2f417ae3dae2/users/ea2faca4533646dc979bdddcc2c32ea2/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.834174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32615f90d5664174ac0e2f417ae3dae2, user_id=ea2faca4533646dc979bdddcc2c32ea2, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:55.836782 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:55.846775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1312/2612] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:05:55 2022] PUT /identity/v3/projects/32615f90d5664174ac0e2f417ae3dae2/users/ea2faca4533646dc979bdddcc2c32ea2/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:05:55.856811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494550b-dbe6-4bb6-b65f-397f8509ace8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:55.857108 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494550b-dbe6-4bb6-b65f-397f8509ace8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:55.857393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494550b-dbe6-4bb6-b65f-397f8509ace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:55.884087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a494550b-dbe6-4bb6-b65f-397f8509ace8 None None] MFA Rules not processed for user `ea2faca4533646dc979bdddcc2c32ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:05:55.885290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a494550b-dbe6-4bb6-b65f-397f8509ace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:55.951728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1301/2613] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:05:55.963154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:55.964898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:05:56.021266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00382-1964-4cb9-8846-b40a0610c712 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:56.024916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:56.025548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:56.025875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:56.026157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:56.035011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:56.036939 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:56.046454 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1313/2614] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:05:56.114587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494550b-dbe6-4bb6-b65f-397f8509ace8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:05:56.124803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494550b-dbe6-4bb6-b65f-397f8509ace8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:05:56.128406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:05:56.129031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:05:56.129346 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:05:56.129628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:05:56.137926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:56.187889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:05:56.189337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:05:56.200183 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1302/2615] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:05:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:05.520652 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:05.522089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:05.578826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733660e-4dfb-41b5-af91-3d46e46cd9e8 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:05.583005 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89fb8-656b-479f-996a-1a12d95cef33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:05.583646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89fb8-656b-479f-996a-1a12d95cef33 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:05.583938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89fb8-656b-479f-996a-1a12d95cef33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:05.584358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89fb8-656b-479f-996a-1a12d95cef33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:05.586148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9ab89fb8-656b-479f-996a-1a12d95cef33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:05.655726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab89fb8-656b-479f-996a-1a12d95cef33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:05.657294 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab89fb8-656b-479f-996a-1a12d95cef33 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:05.669058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1314/2616] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:06.195614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=23 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:07.562996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:07.651725 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e0c92-915d-462b-b5ef-2bc136d1f009 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:07.657518 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:07.658443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:07.658729 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:07.659009 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] PATH_INFO: `/v3/users/589dea66480743f2853b0969080b3e35` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:07.660837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589dea66480743f2853b0969080b3e35)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:07.663363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:07.718475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589dea66480743f2853b0969080b3e35'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:07.726167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589dea66480743f2853b0969080b3e35'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:07.727093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589dea66480743f2853b0969080b3e35'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:07.735825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589dea66480743f2853b0969080b3e35'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:07.736737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589dea66480743f2853b0969080b3e35'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:07.762023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1303/2617] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:07 2022] DELETE /identity/v3/users/589dea66480743f2853b0969080b3e35 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:07.766823 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:07.767314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:07.767424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:07.786368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:07.788064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:07.798300 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:07.857655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1315/2618] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:06:07.867256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:07.869159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:07.931953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475cd08-8912-4bed-b137-393bcda6ee05 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:07.935799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:07.936468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:07.936938 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:07.937227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:07.948531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:07.950144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:07.966199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1304/2619] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:08.307522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:08.310154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:08.350109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359ff52-dda2-4573-8d5e-8f82325e4439 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:08.366768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:08.367731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:08.368267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:08.368800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] PATH_INFO: `/v3/projects/6706f3eba6df49f39f7beea68754e6dd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:08.371794 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6706f3eba6df49f39f7beea68754e6dd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:08.374049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:08.463530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6706f3eba6df49f39f7beea68754e6dd', 'request_id': 'req-19b32247-e308-4845-b5cf-14d18f051b5e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.469426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6706f3eba6df49f39f7beea68754e6dd', 'request_id': 'req-19b32247-e308-4845-b5cf-14d18f051b5e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.479038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6706f3eba6df49f39f7beea68754e6dd', 'request_id': 'req-19b32247-e308-4845-b5cf-14d18f051b5e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.495855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] The token cache is being invalidate because project 6706f3eba6df49f39f7beea68754e6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:08.496202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.496824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.499264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1316/2620] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:08 2022] DELETE /identity/v3/projects/6706f3eba6df49f39f7beea68754e6dd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:08.503528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:08.516753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ac2c-458d-4e42-ae81-89342987b4f5 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:08.552813 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:08.598389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:08.599138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:08.599428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:08.599709 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] PATH_INFO: `/v3/users/ea2faca4533646dc979bdddcc2c32ea2` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:08.600896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2faca4533646dc979bdddcc2c32ea2)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:08.602914 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:08.654984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2faca4533646dc979bdddcc2c32ea2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.663331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2faca4533646dc979bdddcc2c32ea2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.664056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2faca4533646dc979bdddcc2c32ea2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.670990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2faca4533646dc979bdddcc2c32ea2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.671667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5190ae56-1461-4132-b48a-97a4ac96992d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2faca4533646dc979bdddcc2c32ea2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:08.690047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1305/2621] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:08 2022] DELETE /identity/v3/users/ea2faca4533646dc979bdddcc2c32ea2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:08.981775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:08.983363 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:09.000704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b32247-e308-4845-b5cf-14d18f051b5e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.061027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.061920 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.062211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.062488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] PATH_INFO: `/v3/projects/32615f90d5664174ac0e2f417ae3dae2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.063955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32615f90d5664174ac0e2f417ae3dae2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.065967 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.105606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:09.114461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32615f90d5664174ac0e2f417ae3dae2', 'request_id': 'req-4029cb13-157f-4206-b8d5-193d346e5688'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:09.119957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32615f90d5664174ac0e2f417ae3dae2', 'request_id': 'req-4029cb13-157f-4206-b8d5-193d346e5688'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:09.126465 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32615f90d5664174ac0e2f417ae3dae2', 'request_id': 'req-4029cb13-157f-4206-b8d5-193d346e5688'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:09.138810 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] The token cache is being invalidate because project 32615f90d5664174ac0e2f417ae3dae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:09.139098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:09.139723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4029cb13-157f-4206-b8d5-193d346e5688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:09.141283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1317/2622] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:08 2022] DELETE /identity/v3/projects/32615f90d5664174ac0e2f417ae3dae2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:09.146222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdc96b-bab0-409d-a9c3-ace5bbd22a82 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.146541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdc96b-bab0-409d-a9c3-ace5bbd22a82 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.146825 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdc96b-bab0-409d-a9c3-ace5bbd22a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.164204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6ebdc96b-bab0-409d-a9c3-ace5bbd22a82 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:09.165428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6ebdc96b-bab0-409d-a9c3-ace5bbd22a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:09.224442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1306/2623] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:06:09.232190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9988956-9e10-4d49-95de-209af46d21a8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.232524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9988956-9e10-4d49-95de-209af46d21a8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.232796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9988956-9e10-4d49-95de-209af46d21a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.250884 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a9988956-9e10-4d49-95de-209af46d21a8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:09.252068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a9988956-9e10-4d49-95de-209af46d21a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:09.259870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1318/2624] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:09.263830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdc96b-bab0-409d-a9c3-ace5bbd22a82 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.273871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdc96b-bab0-409d-a9c3-ace5bbd22a82 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.279326 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.280031 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.280386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.280762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.281648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:06:09.282052 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.284077 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.296520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1307/2625] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:06:09.300662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9988956-9e10-4d49-95de-209af46d21a8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.309722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9988956-9e10-4d49-95de-209af46d21a8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.314499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.315137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.315422 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.315697 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.316382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.318304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.345554 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1319/2626] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:09 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:09.350205 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.360130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9158e-c659-4678-9cee-fa1a0c45ec8e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.385520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:09.418688 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.419353 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.419637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.419915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.420614 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.422587 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.441463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1308/2627] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:09 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:09.445538 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.455827 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73182a-f4f7-442d-b30f-bedb81b1b02f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.461087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.461741 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.462048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.462327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.463046 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.464633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.476382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1320/2628] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:09.480098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.489990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b2c7-460f-427f-bd50-a38166aeb21f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.494610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762de26d-040b-4df0-9abb-40d00466204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.495253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de26d-040b-4df0-9abb-40d00466204d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.495538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de26d-040b-4df0-9abb-40d00466204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.495816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de26d-040b-4df0-9abb-40d00466204d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.496522 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762de26d-040b-4df0-9abb-40d00466204d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.498134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762de26d-040b-4df0-9abb-40d00466204d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.508265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1309/2629] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:09.512084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.522197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c925e-e6c8-44c6-a599-5d281bc2b042 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.526811 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.527671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.527953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.528231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] PATH_INFO: `/v3/projects/5134e15052e3450ab25d5d73a76b9a76/users/cfb288d428394221bef407ac56171ff2/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.542854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5134e15052e3450ab25d5d73a76b9a76, user_id=cfb288d428394221bef407ac56171ff2, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.545475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.558083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1321/2630] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:09 2022] PUT /identity/v3/projects/5134e15052e3450ab25d5d73a76b9a76/users/cfb288d428394221bef407ac56171ff2/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:09.570559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.570854 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.571137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.599527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] MFA Rules not processed for user `cfb288d428394221bef407ac56171ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:09.600739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:09.676871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1310/2631] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:09.681344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.696135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.697594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:09.760512 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96f217-c4bc-4346-8896-02d72f360373 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.763026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb322b10-d231-4ca2-9dff-119dd21b563a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.766756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.767409 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.767698 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.767979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.770818 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:09.773186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.773906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.774271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.774466 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.775155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.777043 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.783618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.785117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.795527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1311/2632] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 10:06:09.802800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1322/2633] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:09 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:09.806701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.816945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e089888-b64f-4c9e-89ff-2b297b8f9696 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.856314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:09.880450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.881069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.881366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.881640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.882389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.884299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.906050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1312/2634] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:09 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:09.909926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.920628 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c126276-d6fa-4862-bdd2-6cbf31db0f2a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.927235 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.927891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.928188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.928464 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.929186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.930817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.942136 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1323/2635] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:09.946872 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:09.956843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4e8a9-402d-4a0c-8064-e1e42d9c318c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:09.961519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:09.962447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:09.962717 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:09.962994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] PATH_INFO: `/v3/projects/6db95b1d16f64eb8be3e47650e14a557/users/86334d4d455143e0a550461e553d07a9/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:09.977925 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db95b1d16f64eb8be3e47650e14a557, user_id=86334d4d455143e0a550461e553d07a9, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:09.980569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:09.993850 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1313/2636] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:09 2022] PUT /identity/v3/projects/6db95b1d16f64eb8be3e47650e14a557/users/86334d4d455143e0a550461e553d07a9/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:09.997696 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:10.008222 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30b409-bbd0-409d-8403-497c063ae416 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:10.042998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:10.071064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da1ddf-8a03-4e62-be42-12a79ca5c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:10.071755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da1ddf-8a03-4e62-be42-12a79ca5c084 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:10.072047 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da1ddf-8a03-4e62-be42-12a79ca5c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:10.072329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da1ddf-8a03-4e62-be42-12a79ca5c084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:10.073063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da1ddf-8a03-4e62-be42-12a79ca5c084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:10.074726 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da1ddf-8a03-4e62-be42-12a79ca5c084 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:10.085283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1324/2637] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:10.089132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:10.099721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7c4cc-de5f-46aa-89f5-e0f726458603 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:10.105814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:10.106714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:10.106996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:10.107272 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] PATH_INFO: `/v3/projects/6db95b1d16f64eb8be3e47650e14a557/users/86334d4d455143e0a550461e553d07a9/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:10.109224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db95b1d16f64eb8be3e47650e14a557, user_id=86334d4d455143e0a550461e553d07a9, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:10.111934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:10.124138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1314/2638] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:10 2022] PUT /identity/v3/projects/6db95b1d16f64eb8be3e47650e14a557/users/86334d4d455143e0a550461e553d07a9/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:10.134595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c854f-0a06-4e3b-b4b6-6fcf7731f6ea None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:10.134886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c854f-0a06-4e3b-b4b6-6fcf7731f6ea None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:10.135108 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c854f-0a06-4e3b-b4b6-6fcf7731f6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:10.163202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-479c854f-0a06-4e3b-b4b6-6fcf7731f6ea None None] MFA Rules not processed for user `86334d4d455143e0a550461e553d07a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:10.164420 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-479c854f-0a06-4e3b-b4b6-6fcf7731f6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:10.236347 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1325/2639] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:10.247936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:10.249731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:10.315852 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768ee79-8f34-4642-98af-81a6a2a7851a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:10.320008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef1032-ac89-43d3-952f-830065c8c5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:10.320662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef1032-ac89-43d3-952f-830065c8c5bd service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:10.320949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef1032-ac89-43d3-952f-830065c8c5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:10.321230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef1032-ac89-43d3-952f-830065c8c5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:10.330930 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef1032-ac89-43d3-952f-830065c8c5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:10.332974 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef1032-ac89-43d3-952f-830065c8c5bd service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:10.342773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1315/2640] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:10.382557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c854f-0a06-4e3b-b4b6-6fcf7731f6ea None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:10.448583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c854f-0a06-4e3b-b4b6-6fcf7731f6ea None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:10.453198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:10.454180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:10.454470 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:10.454751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] PATH_INFO: `/v3/users/cfb288d428394221bef407ac56171ff2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:10.455965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb288d428394221bef407ac56171ff2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:10.458515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:10.507690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb288d428394221bef407ac56171ff2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:10.515169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb288d428394221bef407ac56171ff2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:10.515875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb288d428394221bef407ac56171ff2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:10.520129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:10.524686 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb288d428394221bef407ac56171ff2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:10.525496 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb288d428394221bef407ac56171ff2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:10.545334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1326/2641] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:10 2022] DELETE /identity/v3/users/cfb288d428394221bef407ac56171ff2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:10.549885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:10.550187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:10.550472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:10.568476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:10.569673 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:10.631798 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1316/2642] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:10.641427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:10.642896 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:10.701447 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b235731-4334-4926-b777-6fc526223a90 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:10.705275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:10.705954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:10.706244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:10.706526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:10.715791 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:10.717242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:10.726860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1327/2643] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:11.381357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:11.383255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:11.398951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3a5d8-f379-4abd-86e8-14692882f6af None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:11.403951 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:11.404968 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:11.405531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:11.405531 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] PATH_INFO: `/v3/projects/5134e15052e3450ab25d5d73a76b9a76` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:11.417649 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5134e15052e3450ab25d5d73a76b9a76)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:11.423004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:11.480419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:11.497891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5134e15052e3450ab25d5d73a76b9a76', 'request_id': 'req-6099371f-b71f-4dea-bfa9-e7d7ad552f60'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.505033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5134e15052e3450ab25d5d73a76b9a76', 'request_id': 'req-6099371f-b71f-4dea-bfa9-e7d7ad552f60'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.512940 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5134e15052e3450ab25d5d73a76b9a76', 'request_id': 'req-6099371f-b71f-4dea-bfa9-e7d7ad552f60'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.533995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] The token cache is being invalidate because project 5134e15052e3450ab25d5d73a76b9a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:11.534292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.535016 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.537993 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1317/2644] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:11 2022] DELETE /identity/v3/projects/5134e15052e3450ab25d5d73a76b9a76 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:11.541584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:11.553414 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84278816-28e8-4520-99a9-9ee2b4b1b03d service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:11.620261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:11.621165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:11.621452 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:11.621783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] PATH_INFO: `/v3/users/86334d4d455143e0a550461e553d07a9` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:11.623230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86334d4d455143e0a550461e553d07a9)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:11.625307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:11.685274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86334d4d455143e0a550461e553d07a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.693211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86334d4d455143e0a550461e553d07a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.694038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86334d4d455143e0a550461e553d07a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.703321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86334d4d455143e0a550461e553d07a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.704033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2979c4f-1ce6-41bb-abe3-d82db19f0318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86334d4d455143e0a550461e553d07a9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:11.728975 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:11.733965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1328/2645] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:11 2022] DELETE /identity/v3/users/86334d4d455143e0a550461e553d07a9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:12.158942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:12.160785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:12.181944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099371f-b71f-4dea-bfa9-e7d7ad552f60 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:12.270241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:12.271467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.271713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.271996 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] PATH_INFO: `/v3/projects/6db95b1d16f64eb8be3e47650e14a557` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.274802 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db95b1d16f64eb8be3e47650e14a557)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:12.276884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:12.343744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db95b1d16f64eb8be3e47650e14a557', 'request_id': 'req-f52900be-75ed-4c32-ac77-fe21e53db38e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:12.365465 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db95b1d16f64eb8be3e47650e14a557', 'request_id': 'req-f52900be-75ed-4c32-ac77-fe21e53db38e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:12.374260 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db95b1d16f64eb8be3e47650e14a557', 'request_id': 'req-f52900be-75ed-4c32-ac77-fe21e53db38e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:12.399682 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] The token cache is being invalidate because project 6db95b1d16f64eb8be3e47650e14a557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:12.400063 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:12.401534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f52900be-75ed-4c32-ac77-fe21e53db38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:12.404570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1318/2646] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:12 2022] DELETE /identity/v3/projects/6db95b1d16f64eb8be3e47650e14a557 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:12.409278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793adf21-7148-4488-8bc4-75886d97e800 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.409989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793adf21-7148-4488-8bc4-75886d97e800 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.411015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793adf21-7148-4488-8bc4-75886d97e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.439198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-793adf21-7148-4488-8bc4-75886d97e800 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:12.440801 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-793adf21-7148-4488-8bc4-75886d97e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:12.517725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1329/2647] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:12.526832 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d129-3a13-4631-a36b-a3fe8135c505 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.527206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d129-3a13-4631-a36b-a3fe8135c505 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.527549 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d129-3a13-4631-a36b-a3fe8135c505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.551135 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9900d129-3a13-4631-a36b-a3fe8135c505 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:12.552543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9900d129-3a13-4631-a36b-a3fe8135c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:12.562769 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1319/2648] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:12.567271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793adf21-7148-4488-8bc4-75886d97e800 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:12.577087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793adf21-7148-4488-8bc4-75886d97e800 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:12.581891 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:12.583234 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.583604 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.583944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.584729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:06:12.585327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:12.586784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:12.599921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1330/2649] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:06:12.604408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d129-3a13-4631-a36b-a3fe8135c505 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:12.615538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d129-3a13-4631-a36b-a3fe8135c505 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:12.621874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:12.622540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.622841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.623102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.623795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:12.625696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:12.657721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1320/2650] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:12 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:06:12.659572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:12.670897 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6797ab8-c6da-4077-afbc-28b78de49c34 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:12.737180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:12.738033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.738437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.738793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.739599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:12.741657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:12.765793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1331/2651] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:12 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:12.768597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:12.780002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7843-d99f-4666-88d7-d21e537de4d5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:12.785152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:12.785874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.786167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.786579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.787647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:12.789540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:12.800745 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1321/2652] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:12.804957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:12.818296 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a83c5b-abdd-4aa9-8317-058fce6ab294 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:12.823960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eccd2b-9936-4c63-b13f-a6877f2a9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:12.824723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eccd2b-9936-4c63-b13f-a6877f2a9eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.825008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eccd2b-9936-4c63-b13f-a6877f2a9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.825285 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eccd2b-9936-4c63-b13f-a6877f2a9eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.826062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eccd2b-9936-4c63-b13f-a6877f2a9eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:12.827722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eccd2b-9936-4c63-b13f-a6877f2a9eb6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:12.841058 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1332/2653] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:12.845434 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:12.857150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16b6df-27b8-4559-b898-f19307c1526e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:12.862044 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:12.863004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.863888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.864171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] PATH_INFO: `/v3/projects/8caa396426844ea59f79bd6bb42cf7c3/users/fb48c58e47df467c868baf2ec947d53f/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.867328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:12.882628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa396426844ea59f79bd6bb42cf7c3, user_id=fb48c58e47df467c868baf2ec947d53f, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:12.885304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:12.898302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1322/2654] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:12 2022] PUT /identity/v3/projects/8caa396426844ea59f79bd6bb42cf7c3/users/fb48c58e47df467c868baf2ec947d53f/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:12.909152 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04eb67-d641-4c1b-9083-9791709d024c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:12.909481 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04eb67-d641-4c1b-9083-9791709d024c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:12.909793 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04eb67-d641-4c1b-9083-9791709d024c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:12.936698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3d04eb67-d641-4c1b-9083-9791709d024c None None] MFA Rules not processed for user `fb48c58e47df467c868baf2ec947d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:12.937934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3d04eb67-d641-4c1b-9083-9791709d024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:13.000435 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:13.011840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1333/2655] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:13.016560 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:13.088654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68feff1-c41b-4f25-8167-bdd0b18c6fad admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:13.094295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:13.095103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.095469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.095827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.096601 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:13.098700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:13.134668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1323/2656] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:13 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:13.136623 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04eb67-d641-4c1b-9083-9791709d024c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:13.148072 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04eb67-d641-4c1b-9083-9791709d024c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:13.213316 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:13.214000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.214288 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.214564 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.215249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:13.217150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:13.237462 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1334/2657] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:13 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:13.242025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:13.253224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7801d9-faa6-4480-bf01-d3205eba2397 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:13.258443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:13.259234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.259558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.259947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.260811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:13.262871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:13.274757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1324/2658] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:13.279555 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:13.291661 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf917c7-3b6a-4f27-beb6-5e9346fd9352 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:13.296982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:13.298078 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.298437 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.298878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] PATH_INFO: `/v3/projects/6c588bb525fd4d559481f62ceff3317b/users/60b051f876dc420c8ffc8e67539e0791/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.317051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c588bb525fd4d559481f62ceff3317b, user_id=60b051f876dc420c8ffc8e67539e0791, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:13.319751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:13.337557 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1335/2659] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:13 2022] PUT /identity/v3/projects/6c588bb525fd4d559481f62ceff3317b/users/60b051f876dc420c8ffc8e67539e0791/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:13.339129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:13.350033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58dc8-57bc-4074-b04f-51e50ea14d43 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:13.421426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ec2be-dbe9-458f-be26-5103ad84d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:13.422243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ec2be-dbe9-458f-be26-5103ad84d1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.423863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ec2be-dbe9-458f-be26-5103ad84d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.423863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ec2be-dbe9-458f-be26-5103ad84d1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.423863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ec2be-dbe9-458f-be26-5103ad84d1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:13.426422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ec2be-dbe9-458f-be26-5103ad84d1e2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:13.438578 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1325/2660] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:06:13.442524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:13.459202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70191f-fec4-4f06-92cf-3678f9024237 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:13.464405 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:13.465385 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.465870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.466150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] PATH_INFO: `/v3/projects/6c588bb525fd4d559481f62ceff3317b/users/60b051f876dc420c8ffc8e67539e0791/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.468377 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c588bb525fd4d559481f62ceff3317b, user_id=60b051f876dc420c8ffc8e67539e0791, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:13.472035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:13.484735 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1336/2661] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:13 2022] PUT /identity/v3/projects/6c588bb525fd4d559481f62ceff3317b/users/60b051f876dc420c8ffc8e67539e0791/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:13.505085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4dd3-abff-48be-a065-27e81bdcc2ce None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.505085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4dd3-abff-48be-a065-27e81bdcc2ce None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.505085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4dd3-abff-48be-a065-27e81bdcc2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.532891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-808f4dd3-abff-48be-a065-27e81bdcc2ce None None] MFA Rules not processed for user `60b051f876dc420c8ffc8e67539e0791`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:13.534171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-808f4dd3-abff-48be-a065-27e81bdcc2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:13.598157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:13.635859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1326/2662] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:13.647812 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:13.649650 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:13.755647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94518a09-006b-4798-bf9f-9f151c4700c1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:13.764140 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:13.765933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:13.767930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:13.768340 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:13.794475 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:13.796258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:13.812228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1337/2663] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 10:06:13.992637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f4dd3-abff-48be-a065-27e81bdcc2ce None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.086377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f4dd3-abff-48be-a065-27e81bdcc2ce None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.091830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:14.092760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.093767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.093767 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] PATH_INFO: `/v3/users/fb48c58e47df467c868baf2ec947d53f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.095167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb48c58e47df467c868baf2ec947d53f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:14.097314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:14.188899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb48c58e47df467c868baf2ec947d53f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.203051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb48c58e47df467c868baf2ec947d53f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.203999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb48c58e47df467c868baf2ec947d53f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.213109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb48c58e47df467c868baf2ec947d53f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.217159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-401b3562-b23b-455c-9650-e28820a0c551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb48c58e47df467c868baf2ec947d53f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.221053 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.223382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.238532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b603-e6e2-4dd4-a894-b26ee09954ea service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.240919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1327/2664] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:13 2022] DELETE /identity/v3/users/fb48c58e47df467c868baf2ec947d53f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:14.243322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:14.244428 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.244629 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.244955 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] PATH_INFO: `/v3/users/c216711b9e9b45f09f4917fe7b8275ab` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.245508 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.246001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.246202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.246329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c216711b9e9b45f09f4917fe7b8275ab)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:14.248203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:14.265655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:14.266853 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.297895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:14.299824 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c216711b9e9b45f09f4917fe7b8275ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.309333 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c216711b9e9b45f09f4917fe7b8275ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.310017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c216711b9e9b45f09f4917fe7b8275ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.318074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c216711b9e9b45f09f4917fe7b8275ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.318734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c216711b9e9b45f09f4917fe7b8275ab'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.322347 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:14.336791 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1328/2665] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:06:14.342783 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1338/2666] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:14 2022] DELETE /identity/v3/users/c216711b9e9b45f09f4917fe7b8275ab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:06:14.343666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.345140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.411746 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd44f8-3e74-436f-84a9-df842a038c85 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.461012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea275f5b-9675-404c-ba26-b54dbea76516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:14.461667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275f5b-9675-404c-ba26-b54dbea76516 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.461988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275f5b-9675-404c-ba26-b54dbea76516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.462302 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275f5b-9675-404c-ba26-b54dbea76516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.519925 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.521328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.525106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea275f5b-9675-404c-ba26-b54dbea76516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:14.526784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea275f5b-9675-404c-ba26-b54dbea76516 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:14.539519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1329/2667] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 10:06:14.542784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d18390-c6f4-4dac-825e-8d75dc71839b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.549390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:14.550478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.551383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.551817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] PATH_INFO: `/v3/projects/a937f473cd1b44bc8d628c7cadb18856` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.553056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a937f473cd1b44bc8d628c7cadb18856)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:14.555350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:14.604880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a937f473cd1b44bc8d628c7cadb18856', 'request_id': 'req-7aa14ba0-f200-4f55-ab06-754b8cd03e21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.612289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a937f473cd1b44bc8d628c7cadb18856', 'request_id': 'req-7aa14ba0-f200-4f55-ab06-754b8cd03e21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.621606 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a937f473cd1b44bc8d628c7cadb18856', 'request_id': 'req-7aa14ba0-f200-4f55-ab06-754b8cd03e21'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.633514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] The token cache is being invalidate because project a937f473cd1b44bc8d628c7cadb18856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:14.633828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.634479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7aa14ba0-f200-4f55-ab06-754b8cd03e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.636029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1339/2668] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:14 2022] DELETE /identity/v3/projects/a937f473cd1b44bc8d628c7cadb18856 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:06:14.641075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add63a3-4461-411f-8456-af9a95393821 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.641398 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add63a3-4461-411f-8456-af9a95393821 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.641693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add63a3-4461-411f-8456-af9a95393821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.660040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2add63a3-4461-411f-8456-af9a95393821 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:14.661243 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2add63a3-4461-411f-8456-af9a95393821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.731424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1330/2669] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:06:14.739698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2a94-dd7d-4ca0-b548-8a690c75a1fe None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.740208 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2a94-dd7d-4ca0-b548-8a690c75a1fe None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.740338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2a94-dd7d-4ca0-b548-8a690c75a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.758927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-153b2a94-dd7d-4ca0-b548-8a690c75a1fe None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:14.760127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-153b2a94-dd7d-4ca0-b548-8a690c75a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.768229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1340/2670] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:14.772528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add63a3-4461-411f-8456-af9a95393821 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.782686 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add63a3-4461-411f-8456-af9a95393821 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.788296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:14.788969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.789257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.789538 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.790299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:06:14.790607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:14.792397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:14.793891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:14.812289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1331/2671] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:06:14.814009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b2a94-dd7d-4ca0-b548-8a690c75a1fe None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.824864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b2a94-dd7d-4ca0-b548-8a690c75a1fe None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.827943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.829819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:14.830148 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.830477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.830761 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.831094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.831731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:14.835137 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:14.845799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85573-ebca-49fc-9408-aad757e1da7d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.851661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:14.852607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:14.852922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:14.853224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] PATH_INFO: `/v3/projects/8caa396426844ea59f79bd6bb42cf7c3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:14.854634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caa396426844ea59f79bd6bb42cf7c3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:14.856760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:14.866957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1341/2672] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:14 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:14.871075 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.912785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caa396426844ea59f79bd6bb42cf7c3', 'request_id': 'req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.919776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caa396426844ea59f79bd6bb42cf7c3', 'request_id': 'req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.925293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caa396426844ea59f79bd6bb42cf7c3', 'request_id': 'req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.936803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186fdde-2ef4-4b4d-ab14-e586363a6b2f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:14.938697 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] The token cache is being invalidate because project 8caa396426844ea59f79bd6bb42cf7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:14.938984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.939827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:14.941464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1332/2673] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:14 2022] DELETE /identity/v3/projects/8caa396426844ea59f79bd6bb42cf7c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:14.945506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:14.946917 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:14.960814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:15.001068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.001764 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.002063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.002362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.003054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.005054 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.011929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ba0c-0fb6-4187-bd08-33c74dc442ff admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.017949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.018888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.019167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.019467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] PATH_INFO: `/v3/users/60b051f876dc420c8ffc8e67539e0791` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.020667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b051f876dc420c8ffc8e67539e0791)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.022630 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.026087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1342/2674] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:14 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:06:15.030232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.031921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:15.044907 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a37259-9cb8-4a2e-81bb-628955b40e95 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.050045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.050755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.051579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.051861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.052590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.054230 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.065698 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1343/2675] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:06:15.069728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.079419 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd0b5-3b1c-4981-b70d-3be28073f8b7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.080885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b051f876dc420c8ffc8e67539e0791'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.084040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.084669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.084953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.085228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.085974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.087530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.087722 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b051f876dc420c8ffc8e67539e0791'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.088405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b051f876dc420c8ffc8e67539e0791'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.097227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b051f876dc420c8ffc8e67539e0791'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.098374 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4f0d4040-9005-45b0-abf4-b37c18cea177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b051f876dc420c8ffc8e67539e0791'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.098833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1344/2676] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:06:15.102882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.104544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:15.112856 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:15.117733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dc999-401b-4146-8fa1-cd60f2e68f62 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.125006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1333/2677] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:14 2022] DELETE /identity/v3/users/60b051f876dc420c8ffc8e67539e0791 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:06:15.125162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.125162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.125162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.125162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] PATH_INFO: `/v3/projects/02a9ee05c1ee47e08b2f7c1601dda3c2/users/617a19a03f4941dd98022cf3f8397fef/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.140809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a9ee05c1ee47e08b2f7c1601dda3c2, user_id=617a19a03f4941dd98022cf3f8397fef, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.143632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.157728 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1345/2678] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:15 2022] PUT /identity/v3/projects/02a9ee05c1ee47e08b2f7c1601dda3c2/users/617a19a03f4941dd98022cf3f8397fef/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:06:15.163833 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.164129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.164415 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.181949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:15.183223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:15.246482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1334/2679] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:15.256701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.258458 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:15.320461 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a0bb9-3d36-4d11-9900-87aa3baca31f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.324429 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bba45-3233-4dbf-8a0f-fbf610ca8cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.325083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bba45-3233-4dbf-8a0f-fbf610ca8cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.325376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bba45-3233-4dbf-8a0f-fbf610ca8cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.325659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bba45-3233-4dbf-8a0f-fbf610ca8cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.335638 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bba45-3233-4dbf-8a0f-fbf610ca8cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.337088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bba45-3233-4dbf-8a0f-fbf610ca8cb1 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.347344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1346/2680] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:15.458358 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.459823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:15.471807 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731295-fc1c-4d8a-8a76-ec75a7ac5e9e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.479216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.480085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.480413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.480747 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] PATH_INFO: `/v3/projects/6c588bb525fd4d559481f62ceff3317b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.482318 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c588bb525fd4d559481f62ceff3317b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.484448 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.537648 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c588bb525fd4d559481f62ceff3317b', 'request_id': 'req-17ad67a5-7763-4e58-b313-fc9d0ac48c21'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.544282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c588bb525fd4d559481f62ceff3317b', 'request_id': 'req-17ad67a5-7763-4e58-b313-fc9d0ac48c21'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.551196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c588bb525fd4d559481f62ceff3317b', 'request_id': 'req-17ad67a5-7763-4e58-b313-fc9d0ac48c21'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.563890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] The token cache is being invalidate because project 6c588bb525fd4d559481f62ceff3317b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:15.564187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.564837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17ad67a5-7763-4e58-b313-fc9d0ac48c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:15.567084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1335/2681] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:15 2022] DELETE /identity/v3/projects/6c588bb525fd4d559481f62ceff3317b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:15.571933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a7a86-11ac-4984-bc9c-7c05709f5325 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.572228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a7a86-11ac-4984-bc9c-7c05709f5325 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.572535 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a7a86-11ac-4984-bc9c-7c05709f5325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.598491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-965a7a86-11ac-4984-bc9c-7c05709f5325 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:15.599710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-965a7a86-11ac-4984-bc9c-7c05709f5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:15.667748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1347/2682] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:15.732167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d89935-02c1-44d4-abd4-6b80cf5882b8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.732716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d89935-02c1-44d4-abd4-6b80cf5882b8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.733075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d89935-02c1-44d4-abd4-6b80cf5882b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.755174 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-17d89935-02c1-44d4-abd4-6b80cf5882b8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:15.756463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-17d89935-02c1-44d4-abd4-6b80cf5882b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:15.765443 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1336/2683] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:15.770160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a7a86-11ac-4984-bc9c-7c05709f5325 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.781581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a7a86-11ac-4984-bc9c-7c05709f5325 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.786639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.787579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.787995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.788284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.789266 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:06:15.789585 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.791220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.799530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:15.810732 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d89935-02c1-44d4-abd4-6b80cf5882b8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.810927 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1348/2684] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:06:15.831511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d89935-02c1-44d4-abd4-6b80cf5882b8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.841661 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.842901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.843191 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.843469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.844203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.850760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.874502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1337/2685] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:15 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:15.879252 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.889424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c8c0-52d5-4303-9537-40b3692ddfb1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.948246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.949016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.949305 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.949586 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.950339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:15.952407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:15.975963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1349/2686] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:15 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:15.977177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:15.987744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d0da-7765-46c2-bff9-f2ff45cf40d3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:15.995234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:15.996142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:15.996437 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:15.996723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:15.997941 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:16.000012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:16.014857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1338/2687] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:16.019099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:16.029371 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a26e9a-a2bf-49d4-832c-7e2b251f0634 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:16.035052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18c8fb-f0c6-426b-bcb7-3509034e4b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:16.036083 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c8fb-f0c6-426b-bcb7-3509034e4b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:16.036440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c8fb-f0c6-426b-bcb7-3509034e4b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:16.036775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c8fb-f0c6-426b-bcb7-3509034e4b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:16.037881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18c8fb-f0c6-426b-bcb7-3509034e4b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:16.039703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18c8fb-f0c6-426b-bcb7-3509034e4b41 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:16.050148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1350/2688] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:16.054910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:16.065293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3335a-d019-4bf1-a015-c7f1ced67337 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:16.071449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:16.072454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:16.072834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:16.073297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] PATH_INFO: `/v3/projects/74be40bda81d4a43b99e1fe8add8906a/users/7c9f024628f444c0b474b84f589a5fd2/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:16.092187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74be40bda81d4a43b99e1fe8add8906a, user_id=7c9f024628f444c0b474b84f589a5fd2, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:16.094937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:16.112120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1339/2689] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:16 2022] PUT /identity/v3/projects/74be40bda81d4a43b99e1fe8add8906a/users/7c9f024628f444c0b474b84f589a5fd2/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:16.123184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01310dbc-bfba-4fc6-88e2-6c6185f6b33c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:16.123647 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01310dbc-bfba-4fc6-88e2-6c6185f6b33c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:16.123931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01310dbc-bfba-4fc6-88e2-6c6185f6b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:16.155689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-01310dbc-bfba-4fc6-88e2-6c6185f6b33c None None] MFA Rules not processed for user `7c9f024628f444c0b474b84f589a5fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:16.157068 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-01310dbc-bfba-4fc6-88e2-6c6185f6b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:16.237233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1351/2690] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:16.250772 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:16.253199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:16.277196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:16.331464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe829f-48cf-423a-b084-438c2e324977 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:16.337047 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90e22-0233-4801-9049-36830a0ed228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:16.338157 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90e22-0233-4801-9049-36830a0ed228 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:16.338622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90e22-0233-4801-9049-36830a0ed228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:16.339173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90e22-0233-4801-9049-36830a0ed228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:16.350567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90e22-0233-4801-9049-36830a0ed228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:16.352112 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90e22-0233-4801-9049-36830a0ed228 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:16.365830 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1340/2691] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:16.389396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01310dbc-bfba-4fc6-88e2-6c6185f6b33c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:16.469796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01310dbc-bfba-4fc6-88e2-6c6185f6b33c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:16.475349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:16.476327 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:16.476676 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:16.477015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] PATH_INFO: `/v3/users/7c9f024628f444c0b474b84f589a5fd2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:16.482960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9f024628f444c0b474b84f589a5fd2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:16.485603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:16.499789 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:16.554592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9f024628f444c0b474b84f589a5fd2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:16.563632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9f024628f444c0b474b84f589a5fd2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:16.564798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9f024628f444c0b474b84f589a5fd2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:16.575919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9f024628f444c0b474b84f589a5fd2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:16.576839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9f024628f444c0b474b84f589a5fd2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:16.599528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1352/2692] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:16 2022] DELETE /identity/v3/users/7c9f024628f444c0b474b84f589a5fd2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:06:16.611473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:16.611473 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:16.614076 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:16.634760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:16.636263 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:16.706529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1341/2693] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:16.717682 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:16.719193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:16.793969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069338c-23e3-417c-bfa7-875312a934e2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:16.797688 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad3158-6118-4ef2-95be-5500b8e63347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:16.798376 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3158-6118-4ef2-95be-5500b8e63347 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:16.799095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3158-6118-4ef2-95be-5500b8e63347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:16.799095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3158-6118-4ef2-95be-5500b8e63347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:16.810013 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad3158-6118-4ef2-95be-5500b8e63347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:16.811507 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad3158-6118-4ef2-95be-5500b8e63347 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:16.822417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1353/2694] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:17.355498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:17.357093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:17.369596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6893-ded8-474d-bd97-ee60c7205c19 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:17.374240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:17.375106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.375566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.376015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] PATH_INFO: `/v3/projects/74be40bda81d4a43b99e1fe8add8906a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.377405 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74be40bda81d4a43b99e1fe8add8906a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:17.379442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:17.437138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74be40bda81d4a43b99e1fe8add8906a', 'request_id': 'req-58008cda-2e22-4457-8249-2e4d9ac9820b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:17.443564 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74be40bda81d4a43b99e1fe8add8906a', 'request_id': 'req-58008cda-2e22-4457-8249-2e4d9ac9820b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:17.449550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74be40bda81d4a43b99e1fe8add8906a', 'request_id': 'req-58008cda-2e22-4457-8249-2e4d9ac9820b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:17.462861 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] The token cache is being invalidate because project 74be40bda81d4a43b99e1fe8add8906a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:17.463235 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:17.463953 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58008cda-2e22-4457-8249-2e4d9ac9820b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:17.465598 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1342/2695] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:17 2022] DELETE /identity/v3/projects/74be40bda81d4a43b99e1fe8add8906a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:17.470483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828d1f-7a8e-41ad-8562-655ae406547f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.470781 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828d1f-7a8e-41ad-8562-655ae406547f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.471063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828d1f-7a8e-41ad-8562-655ae406547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.489394 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3a828d1f-7a8e-41ad-8562-655ae406547f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:17.490681 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3a828d1f-7a8e-41ad-8562-655ae406547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:17.557341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1354/2696] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:17.565070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0060e0-22a7-4d65-8bd6-62c40ee1ddc5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.565544 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0060e0-22a7-4d65-8bd6-62c40ee1ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.566491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0060e0-22a7-4d65-8bd6-62c40ee1ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.585674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8d0060e0-22a7-4d65-8bd6-62c40ee1ddc5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:17.586935 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8d0060e0-22a7-4d65-8bd6-62c40ee1ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:17.597253 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1343/2697] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:06:17.602162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828d1f-7a8e-41ad-8562-655ae406547f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:17.612087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828d1f-7a8e-41ad-8562-655ae406547f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:17.617574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:17.618303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.618719 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.619011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.619750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:06:17.620065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:17.621703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:17.635259 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1355/2698] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 10:06:17.639931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0060e0-22a7-4d65-8bd6-62c40ee1ddc5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:17.651268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0060e0-22a7-4d65-8bd6-62c40ee1ddc5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:17.659450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:17.660164 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.660458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.660796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.661511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:17.663796 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:17.697803 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1344/2699] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:17 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:06:17.700148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:17.714508 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa182-3eb6-44ce-bcdf-c5c5b202b470 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:17.732519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:17.818370 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:17.819116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.819408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.819946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.820659 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:17.823024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:17.857610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1356/2700] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:17 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:06:17.858900 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:17.873994 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f34fd-a2df-4a49-b2f1-b4685096e124 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:17.890711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:17.891615 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.891910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.892197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.892937 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:17.894762 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:17.922720 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1345/2701] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:17.927099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:17.940864 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21d87-a254-471f-8d59-de405a64e601 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:17.946818 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb51e9-1e19-4fdb-b5da-052b6ba6fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:17.947608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb51e9-1e19-4fdb-b5da-052b6ba6fa25 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:17.947898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb51e9-1e19-4fdb-b5da-052b6ba6fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:17.948184 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb51e9-1e19-4fdb-b5da-052b6ba6fa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:17.948973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb51e9-1e19-4fdb-b5da-052b6ba6fa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:17.951022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb51e9-1e19-4fdb-b5da-052b6ba6fa25 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:17.965790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1357/2702] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:17.969541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:17.978421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:17.987573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdcbb6-a2f6-4726-8477-bf0976597349 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:18.011990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:18.013087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:18.013375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:18.013654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] PATH_INFO: `/v3/projects/fa52851065b0460098b811e8f2902fb6/users/ec8a2947b48443c4ac159b8995880a06/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:18.034733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa52851065b0460098b811e8f2902fb6, user_id=ec8a2947b48443c4ac159b8995880a06, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:18.038633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:18.068090 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1346/2703] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:17 2022] PUT /identity/v3/projects/fa52851065b0460098b811e8f2902fb6/users/ec8a2947b48443c4ac159b8995880a06/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:18.079765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c547a-7b73-4e4d-a860-c5f9749cdadb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:18.080110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c547a-7b73-4e4d-a860-c5f9749cdadb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:18.080849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c547a-7b73-4e4d-a860-c5f9749cdadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:18.151299 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a43c547a-7b73-4e4d-a860-c5f9749cdadb None None] MFA Rules not processed for user `ec8a2947b48443c4ac159b8995880a06`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:18.152745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a43c547a-7b73-4e4d-a860-c5f9749cdadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:18.294505 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1358/2704] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:18.307209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:18.309370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:18.429823 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e72c5d-8ca3-4624-9f94-18ba8cc9f222 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:18.434933 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:18.436282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:18.437114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:18.437114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:18.450799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:18.452416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:18.469169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1347/2705] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:20.060581 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c702f1-d8d6-4655-b1d4-bfd76dfd414c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:20.061110 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c702f1-d8d6-4655-b1d4-bfd76dfd414c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:20.061224 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c702f1-d8d6-4655-b1d4-bfd76dfd414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:20.089800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-94c702f1-d8d6-4655-b1d4-bfd76dfd414c None None] MFA Rules not processed for user `617a19a03f4941dd98022cf3f8397fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:20.091269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-94c702f1-d8d6-4655-b1d4-bfd76dfd414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:20.176362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1359/2706] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:20.192774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:20.194716 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:20.315109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1dca1-c732-4b84-810f-c0c157449691 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:20.325158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:20.326997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:20.327294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:20.327583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:20.339245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:20.342075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:20.353395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1348/2707] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:21.718972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8d28-b364-4b3a-8b7b-48de696ee030 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:21.719467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8d28-b364-4b3a-8b7b-48de696ee030 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:21.719596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8d28-b364-4b3a-8b7b-48de696ee030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:21.740146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5d9a8d28-b364-4b3a-8b7b-48de696ee030 None None] MFA Rules not processed for user `617a19a03f4941dd98022cf3f8397fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:21.741592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5d9a8d28-b364-4b3a-8b7b-48de696ee030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:21.754233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1360/2708] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:29.963629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:30.029373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1304f-1db7-4a2a-a629-7622312dac3a service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:30.033975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:30.035362 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:30.035678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:30.035958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] PATH_INFO: `/v3/users/ec8a2947b48443c4ac159b8995880a06` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:30.037180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8a2947b48443c4ac159b8995880a06)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:30.039419 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:30.045026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:30.090247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8a2947b48443c4ac159b8995880a06'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.098304 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8a2947b48443c4ac159b8995880a06'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.099100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8a2947b48443c4ac159b8995880a06'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.106843 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8a2947b48443c4ac159b8995880a06'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.108022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8a2947b48443c4ac159b8995880a06'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.127399 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1349/2709] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:29 2022] DELETE /identity/v3/users/ec8a2947b48443c4ac159b8995880a06 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:30.131971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:30.132456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:30.132737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:30.146968 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:30.155424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:30.157204 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:30.229743 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1361/2710] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:30.239588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:30.241092 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:30.303701 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea78b8-94b1-4646-bf96-2a157e541da0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:30.307819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:30.308466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:30.308752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:30.309029 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:30.318416 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:30.319857 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:30.329524 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1350/2711] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:30.618932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:30.620493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:30.635953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ab4ff-f92c-4a00-b94f-005ce68a65d5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:30.640655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:30.641572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:30.641888 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:30.642166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] PATH_INFO: `/v3/projects/fa52851065b0460098b811e8f2902fb6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:30.643390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa52851065b0460098b811e8f2902fb6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:30.646062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:30.692685 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa52851065b0460098b811e8f2902fb6', 'request_id': 'req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.698127 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa52851065b0460098b811e8f2902fb6', 'request_id': 'req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.705049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa52851065b0460098b811e8f2902fb6', 'request_id': 'req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.716374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] The token cache is being invalidate because project fa52851065b0460098b811e8f2902fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:30.716645 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.717264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:30.718819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1362/2712] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:30 2022] DELETE /identity/v3/projects/fa52851065b0460098b811e8f2902fb6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:38.618341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:38.619959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:38.633658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932261d0-4901-44cd-8206-b649d6f2117a service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:38.689873 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:38.690749 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:38.691036 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:38.691319 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] PATH_INFO: `/v3/users/1d75851094d145f4907c7049d78dafed` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:38.692610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d75851094d145f4907c7049d78dafed)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:38.694632 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:38.726963 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:38.742015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d75851094d145f4907c7049d78dafed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:38.748757 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d75851094d145f4907c7049d78dafed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:38.749423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d75851094d145f4907c7049d78dafed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:38.756789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d75851094d145f4907c7049d78dafed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:38.757404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d834289-dabe-4bb0-b055-b91fe3b42ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d75851094d145f4907c7049d78dafed'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:38.774141 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1351/2713] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:38 2022] DELETE /identity/v3/users/1d75851094d145f4907c7049d78dafed => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:38.943853 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:38.945303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:38.958123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7d1a-81b3-4a78-aa32-8b902df3c510 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.014408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.015268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.015572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.015850 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] PATH_INFO: `/v3/projects/0ddc37afc4d54ccab945af619507a613` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.017020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddc37afc4d54ccab945af619507a613)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.018948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.060763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:39.075417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddc37afc4d54ccab945af619507a613', 'request_id': 'req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:39.080882 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddc37afc4d54ccab945af619507a613', 'request_id': 'req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:39.087861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddc37afc4d54ccab945af619507a613', 'request_id': 'req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:39.098984 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] The token cache is being invalidate because project 0ddc37afc4d54ccab945af619507a613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:39.099273 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:39.100518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0929ac0c-ecae-4fc5-a243-5198e1b30fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:39.102084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1363/2714] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:38 2022] DELETE /identity/v3/projects/0ddc37afc4d54ccab945af619507a613 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:06:39.107064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594276-08e4-4768-a477-f8b901a771f3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.107360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594276-08e4-4768-a477-f8b901a771f3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.107646 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594276-08e4-4768-a477-f8b901a771f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.124641 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c7594276-08e4-4768-a477-f8b901a771f3 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:39.125944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c7594276-08e4-4768-a477-f8b901a771f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:39.184425 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1352/2715] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:39.192079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02047-0d91-4a08-973d-b637ce3484b8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.192334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02047-0d91-4a08-973d-b637ce3484b8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.192622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02047-0d91-4a08-973d-b637ce3484b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.211239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-95e02047-0d91-4a08-973d-b637ce3484b8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:39.212439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-95e02047-0d91-4a08-973d-b637ce3484b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:39.220397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1364/2716] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:06:39.225202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594276-08e4-4768-a477-f8b901a771f3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:39.235084 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594276-08e4-4768-a477-f8b901a771f3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.239593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.240236 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.240519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.240792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.241502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:06:39.241840 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.243424 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.254593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1353/2717] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:06:39.258598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e02047-0d91-4a08-973d-b637ce3484b8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:39.268090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e02047-0d91-4a08-973d-b637ce3484b8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.273228 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.273948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.274239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.274522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.275223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.277109 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.304141 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1365/2718] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:06:39 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:06:39.308264 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:39.318227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894102-4401-4508-b940-18e77b1d1e20 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.373234 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.373932 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.374223 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.374506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.375224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.377154 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.397593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1354/2719] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:06:39 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:06:39.401637 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:39.411865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20cb3b-0d38-474e-9fb3-206ff51931ed admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.417173 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.417860 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.418154 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.418439 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.419158 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.420753 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.431022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1366/2720] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:06:39.434621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:39.445530 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be5212-9fc5-48f1-87a1-060853269b96 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.450105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d316a-95fe-4d81-a77f-f8e2365601e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.450759 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d316a-95fe-4d81-a77f-f8e2365601e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.451048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d316a-95fe-4d81-a77f-f8e2365601e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.451331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d316a-95fe-4d81-a77f-f8e2365601e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.452049 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d316a-95fe-4d81-a77f-f8e2365601e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.453635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d316a-95fe-4d81-a77f-f8e2365601e3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.464541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1355/2721] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:06:39.468366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:39.478283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9f20-522a-42b6-a57b-2dd8ea578688 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.482919 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.483787 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.484114 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.484493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] PATH_INFO: `/v3/projects/87fa881847db415aa07f285fb9c2549e/users/5439971e9ddf46cb8da8782d952c8c63/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.499757 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fa881847db415aa07f285fb9c2549e, user_id=5439971e9ddf46cb8da8782d952c8c63, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.502478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.515181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1367/2722] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:06:39 2022] PUT /identity/v3/projects/87fa881847db415aa07f285fb9c2549e/users/5439971e9ddf46cb8da8782d952c8c63/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:06:39.526086 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.526381 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.526664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.549623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:39.552760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] MFA Rules not processed for user `5439971e9ddf46cb8da8782d952c8c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:39.554595 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:39.618247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1356/2723] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:06:39.628695 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:39.630378 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:39.686088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287860d7-68b8-41ef-851c-e793cfcef083 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:39.689700 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:39.690368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:39.690653 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:39.690931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:39.699706 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:39.701062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:39.710301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1368/2724] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:43.884816 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:43.886303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:43.941511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a64f4-4f08-4a19-899a-5c5407d738fc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:43.945480 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:43.946212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:43.946497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:43.946774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:43.948500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:44.004074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:44.005499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:44.014758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1357/2725] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:45.039703 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:45.041339 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:45.054077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a25b80-9189-4001-bb8e-09a14b8b427a service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:45.057790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:45.058448 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:45.058734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:45.059016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:45.060895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:45.118772 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:45.140269 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:45.141785 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:45.153528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1369/2726] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:46.331811 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:46.346451 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ca9ff-c851-46e4-9795-d5bfe34bce90 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:46.351216 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:46.352180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:46.352472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:46.352751 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:46.355041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:46.372628 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:46.374118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:46.385999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1358/2727] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:55.148485 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:56.381566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=80 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:57.046314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:57.055157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86fa07-b124-4e7c-b8d4-a7f6c32c6686 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:57.058770 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172fd1-5ac9-41dd-9a4f-3ff5e5cadb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:57.059636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172fd1-5ac9-41dd-9a4f-3ff5e5cadb78 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:57.059933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172fd1-5ac9-41dd-9a4f-3ff5e5cadb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:57.060246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172fd1-5ac9-41dd-9a4f-3ff5e5cadb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:57.062270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ef172fd1-5ac9-41dd-9a4f-3ff5e5cadb78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:57.129610 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef172fd1-5ac9-41dd-9a4f-3ff5e5cadb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:57.131092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef172fd1-5ac9-41dd-9a4f-3ff5e5cadb78 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:57.141185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1370/2728] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:59.119629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:59.130393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309058b9-7d86-45d7-bcbc-62d84bf33bd4 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:59.135545 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:59.136431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:59.136715 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:59.136988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] PATH_INFO: `/v3/users/5439971e9ddf46cb8da8782d952c8c63` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:59.138394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5439971e9ddf46cb8da8782d952c8c63)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:59.140332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:59.193884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5439971e9ddf46cb8da8782d952c8c63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.202251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5439971e9ddf46cb8da8782d952c8c63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.203103 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5439971e9ddf46cb8da8782d952c8c63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.212130 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5439971e9ddf46cb8da8782d952c8c63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.212980 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5439971e9ddf46cb8da8782d952c8c63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.234196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1359/2729] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:06:59 2022] DELETE /identity/v3/users/5439971e9ddf46cb8da8782d952c8c63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:06:59.238593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:59.239099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:59.239202 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:59.256956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:06:59.258805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:59.346893 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1371/2730] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:06:59.356458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:59.358000 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:59.429607 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb339c-4343-4136-9cb7-9d13e993eaba admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:59.433489 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:59.434140 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:59.434430 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:59.434712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:59.444366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:59.446485 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:59.455957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1360/2731] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:06:59.841989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:06:59.843648 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:06:59.856599 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dbe56-824b-4cc5-8fd3-e14931288e4b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:06:59.861291 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:06:59.862199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:06:59.862488 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:06:59.862768 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] PATH_INFO: `/v3/projects/87fa881847db415aa07f285fb9c2549e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:06:59.864143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fa881847db415aa07f285fb9c2549e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:06:59.866095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:06:59.922560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fa881847db415aa07f285fb9c2549e', 'request_id': 'req-a1d2c226-714a-4faa-8e1c-34c686859fa4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.931720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fa881847db415aa07f285fb9c2549e', 'request_id': 'req-a1d2c226-714a-4faa-8e1c-34c686859fa4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.941509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fa881847db415aa07f285fb9c2549e', 'request_id': 'req-a1d2c226-714a-4faa-8e1c-34c686859fa4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.956471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] The token cache is being invalidate because project 87fa881847db415aa07f285fb9c2549e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:06:59.956745 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.957536 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:06:59.968989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1372/2732] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:06:59 2022] DELETE /identity/v3/projects/87fa881847db415aa07f285fb9c2549e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:07:03.565870 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:07:03.571265 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:03.584629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5778b-2b2d-4ee0-b74b-16fae23f38cb service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:07:03.642992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:07:03.643864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:07:03.644150 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:07:03.644433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] PATH_INFO: `/v3/users/3b1e4b0732d34ec896c84cb52a297447` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:07:03.645610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1e4b0732d34ec896c84cb52a297447)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:07:03.647581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:07:03.663681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:03.691984 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1e4b0732d34ec896c84cb52a297447'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:03.699534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1e4b0732d34ec896c84cb52a297447'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:03.700204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1e4b0732d34ec896c84cb52a297447'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:03.707062 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1e4b0732d34ec896c84cb52a297447'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:03.707871 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1e4b0732d34ec896c84cb52a297447'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:03.727713 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1361/2733] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:07:03 2022] DELETE /identity/v3/users/3b1e4b0732d34ec896c84cb52a297447 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:07:03.902656 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:07:03.904295 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:03.918247 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2c226-714a-4faa-8e1c-34c686859fa4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:07:03.932168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:03.977057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:07:03.977873 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:07:03.978163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:07:03.978444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] PATH_INFO: `/v3/projects/475a588bd5a64b508dadf3d93fa5370c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:07:03.979613 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475a588bd5a64b508dadf3d93fa5370c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:07:03.981501 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:07:04.027636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475a588bd5a64b508dadf3d93fa5370c', 'request_id': 'req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.033103 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475a588bd5a64b508dadf3d93fa5370c', 'request_id': 'req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.040278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475a588bd5a64b508dadf3d93fa5370c', 'request_id': 'req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.051180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] The token cache is being invalidate because project 475a588bd5a64b508dadf3d93fa5370c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:07:04.051467 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.052099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.053615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1373/2734] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:07:03 2022] DELETE /identity/v3/projects/475a588bd5a64b508dadf3d93fa5370c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:07:04.058386 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:07:04.059770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:04.072898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4c81-47a6-4b05-ae39-0522614a83e6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:07:04.126893 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:07:04.127754 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:07:04.128035 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:07:04.128313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] PATH_INFO: `/v3/users/bbe6635b5b5146e799f4f992a7cd918b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:07:04.129472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe6635b5b5146e799f4f992a7cd918b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:07:04.131403 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:07:04.178848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe6635b5b5146e799f4f992a7cd918b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.186532 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe6635b5b5146e799f4f992a7cd918b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.187204 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe6635b5b5146e799f4f992a7cd918b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.194506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe6635b5b5146e799f4f992a7cd918b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.195142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe6635b5b5146e799f4f992a7cd918b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.212541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1362/2735] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:07:04 2022] DELETE /identity/v3/users/bbe6635b5b5146e799f4f992a7cd918b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:07:04.390144 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:07:04.392192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:04.407446 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012f15-5661-45cd-a3a0-ed4661ed4fb3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:07:04.464197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:07:04.465048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:07:04.465337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:07:04.465617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] PATH_INFO: `/v3/projects/40fb3851e78d485f940132cbc99f7ad0` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:07:04.466825 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fb3851e78d485f940132cbc99f7ad0)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:07:04.468723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:07:04.513952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fb3851e78d485f940132cbc99f7ad0', 'request_id': 'req-c07af862-415a-4512-849a-cdace5912dce'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.515081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:04.520544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fb3851e78d485f940132cbc99f7ad0', 'request_id': 'req-c07af862-415a-4512-849a-cdace5912dce'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.528664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fb3851e78d485f940132cbc99f7ad0', 'request_id': 'req-c07af862-415a-4512-849a-cdace5912dce'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.542030 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] The token cache is being invalidate because project 40fb3851e78d485f940132cbc99f7ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:07:04.542319 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.542948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:07:04.544472 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1374/2736] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:07:04 2022] DELETE /identity/v3/projects/40fb3851e78d485f940132cbc99f7ad0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:07:14.209015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=19,keystone:SELECT=73,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:14.538450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:48.303290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:07:48.305579 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:48.369760 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f86b2-2d6c-4ccb-876d-0c42fa6bcc43 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:07:48.418027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:07:48.418674 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:07:48.418961 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:07:48.419240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:07:48.421017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:48.430137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:07:48.431558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:07:48.439367 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1363/2737] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:07:49.563194 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:07:49.576885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:49.682792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af862-415a-4512-849a-cdace5912dce admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:07:49.690011 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:07:49.690798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:07:49.691122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:07:49.691473 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:07:49.693351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:49.708244 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:07:49.710190 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:07:49.734213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1375/2738] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:07:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:07:53.004458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:07:53.006015 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:53.022230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966fab-8f69-4d16-862e-b65dcbbec5a5 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:07:53.027672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:07:53.028329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:07:53.028600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:07:53.028924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:07:53.031282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:07:53.044028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:07:53.045704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:07:53.056957 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1364/2739] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:07:59.718843 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=34 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:03.042831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:08:03.044320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:08:03.052922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=52 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:03.056256 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34d2c3-9040-4172-bf53-280b2352675f service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:08:03.059880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:08:03.060519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:08:03.060808 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:08:03.061092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:08:03.063450 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:08:03.126569 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:08:03.128008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:08:03.137965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1376/2740] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:08:09.200960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:08:09.203040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:08:09.257246 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:08:09.259238 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:08:09.273087 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a0553-fdc5-4e01-85a1-8afc634fa41b service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:08:09.278963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:08:09.279834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:08:09.280683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:08:09.280965 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] PATH_INFO: `/v3/users/397ff11fedcc4d17867e1d9c10fcd10f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:08:09.281099 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfde21-fbbc-4b83-95c8-82436f88e5c7 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:08:09.282219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=397ff11fedcc4d17867e1d9c10fcd10f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:08:09.284201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:08:09.286647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:08:09.287494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:08:09.288032 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:08:09.288314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:08:09.290193 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:08:09.302817 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:08:09.304414 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:08:09.314576 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1365/2741] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:08:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:08:09.333677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397ff11fedcc4d17867e1d9c10fcd10f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.340722 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397ff11fedcc4d17867e1d9c10fcd10f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.341407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397ff11fedcc4d17867e1d9c10fcd10f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.350334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397ff11fedcc4d17867e1d9c10fcd10f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.350942 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397ff11fedcc4d17867e1d9c10fcd10f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.368122 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1377/2742] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:08:09 2022] DELETE /identity/v3/users/397ff11fedcc4d17867e1d9c10fcd10f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:08:09.543507 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:08:09.558670 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81264cd-2c47-47ff-8f40-cfc37eb7195b service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:08:09.620693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:08:09.621482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:08:09.621785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:08:09.622074 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] PATH_INFO: `/v3/projects/8a878ecfb9cd47b684c027beb6ad0b03` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:08:09.623251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a878ecfb9cd47b684c027beb6ad0b03)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:08:09.625659 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:08:09.672338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a878ecfb9cd47b684c027beb6ad0b03', 'request_id': 'req-d3dee880-e8f5-4193-87ce-68817fc8411e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.678395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a878ecfb9cd47b684c027beb6ad0b03', 'request_id': 'req-d3dee880-e8f5-4193-87ce-68817fc8411e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.684072 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a878ecfb9cd47b684c027beb6ad0b03', 'request_id': 'req-d3dee880-e8f5-4193-87ce-68817fc8411e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.695771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] The token cache is being invalidate because project 8a878ecfb9cd47b684c027beb6ad0b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:08:09.696061 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.696685 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.698285 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1366/2743] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:08:09 2022] DELETE /identity/v3/projects/8a878ecfb9cd47b684c027beb6ad0b03 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:08:09.702432 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:08:09.703922 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:08:09.716725 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fe447-64e5-439e-9f47-e34da462e4ed admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:08:09.777572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:08:09.778482 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:08:09.778890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:08:09.779167 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] PATH_INFO: `/v3/users/b96eb76f136b4ff8902df06e134efb12` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:08:09.780870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96eb76f136b4ff8902df06e134efb12)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:08:09.782847 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:08:09.788436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:09.834341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96eb76f136b4ff8902df06e134efb12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.841251 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96eb76f136b4ff8902df06e134efb12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.841960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96eb76f136b4ff8902df06e134efb12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.850590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96eb76f136b4ff8902df06e134efb12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.851212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5fd0916d-9d0e-4e93-891e-338630bffef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96eb76f136b4ff8902df06e134efb12'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:09.870545 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1378/2744] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:08:09 2022] DELETE /identity/v3/users/b96eb76f136b4ff8902df06e134efb12 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:08:10.039354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:08:10.040836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:08:10.054058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dee880-e8f5-4193-87ce-68817fc8411e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:08:10.072583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:10.113109 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997952-7be9-4689-930d-3df987193239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:08:10.114006 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997952-7be9-4689-930d-3df987193239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:08:10.114294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997952-7be9-4689-930d-3df987193239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:08:10.114575 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997952-7be9-4689-930d-3df987193239 admin admin] PATH_INFO: `/v3/projects/27cf9487b969471b9cb35cecf7e9e462` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:08:10.115753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92997952-7be9-4689-930d-3df987193239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cf9487b969471b9cb35cecf7e9e462)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:08:10.117665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92997952-7be9-4689-930d-3df987193239 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:08:10.164181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cf9487b969471b9cb35cecf7e9e462', 'request_id': 'req-92997952-7be9-4689-930d-3df987193239'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:10.170226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cf9487b969471b9cb35cecf7e9e462', 'request_id': 'req-92997952-7be9-4689-930d-3df987193239'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:10.176422 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cf9487b969471b9cb35cecf7e9e462', 'request_id': 'req-92997952-7be9-4689-930d-3df987193239'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:10.189085 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92997952-7be9-4689-930d-3df987193239 admin admin] The token cache is being invalidate because project 27cf9487b969471b9cb35cecf7e9e462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:08:10.189378 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:10.190048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:08:10.191675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1367/2745] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:08:10 2022] DELETE /identity/v3/projects/27cf9487b969471b9cb35cecf7e9e462 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:08:19.865407 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:20.185370 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:12.412375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:09:12.413162 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:09:12.413283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:09:12.440537 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] MFA Rules not processed for user `617a19a03f4941dd98022cf3f8397fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:09:12.441736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:09:12.512160 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1379/2746] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:09:12.817442 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:09:12.818883 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:09:12.914559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997952-7be9-4689-930d-3df987193239 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:09:12.918227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:09:12.918868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:09:12.919156 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:09:12.919438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:09:12.921211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:09:12.930958 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:09:12.932393 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:09:12.940240 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1368/2747] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:09:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:09:13.260393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:09:13.261805 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:09:13.342099 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c072d-439e-4303-94ed-bd63f4a150a5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:09:13.346941 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:09:13.347579 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:09:13.348374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:09:13.348649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:09:13.350408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:09:13.361306 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:09:13.362892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:09:13.373121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1380/2748] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:09:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:09:21.607273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:09:21.608766 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:09:21.686225 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308b7ac-1bae-443e-9907-70307918ec52 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:09:21.691690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89ce6057b2843f2bfbc5a143eb9300e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:09:21.692337 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:09:21.692623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:09:21.692903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:09:21.695202 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:09:21.706922 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:09:21.708514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:09:21.718835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1369/2749] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:09:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:09:23.368972 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=72 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:31.714501 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=78 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:25.315155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:25.316675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:25.352622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057d3f-1f78-4401-8e34-fc1d5525f6c6 service placement] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:25.358459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:25.359353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:25.359639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:25.359921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:25.361684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:25.373956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:25.375556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:25.387105 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1381/2750] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:33.589111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:33.591463 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:33.698494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de325ec0-2eeb-49ff-9bb4-45c7486a1697 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:33.703693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:33.704597 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:33.705040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:33.705327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] PATH_INFO: `/v3/users/617a19a03f4941dd98022cf3f8397fef` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:33.706593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617a19a03f4941dd98022cf3f8397fef)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:33.708543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:33.761882 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617a19a03f4941dd98022cf3f8397fef'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:33.769158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617a19a03f4941dd98022cf3f8397fef'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:33.769928 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617a19a03f4941dd98022cf3f8397fef'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:33.778270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617a19a03f4941dd98022cf3f8397fef'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:33.779018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-00f2f28e-c809-4b1e-8b79-6e4411ab75e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617a19a03f4941dd98022cf3f8397fef'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:33.799699 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1370/2751] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:33 2022] DELETE /identity/v3/users/617a19a03f4941dd98022cf3f8397fef => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:33.986815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.000590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94655ed6-bbb5-4758-9864-2a132eae91a0 service placement] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.060113 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.060973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.061262 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.061543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] PATH_INFO: `/v3/projects/02a9ee05c1ee47e08b2f7c1601dda3c2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.062758 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a9ee05c1ee47e08b2f7c1601dda3c2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.064665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.113415 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'request_id': 'req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:34.118948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'request_id': 'req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:34.126201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'request_id': 'req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:34.137362 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] The token cache is being invalidate because project 02a9ee05c1ee47e08b2f7c1601dda3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:34.137651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:34.138303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d502fdc-0f0d-43d9-84e9-0666ccb00fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:34.139820 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1382/2752] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:33 2022] DELETE /identity/v3/projects/02a9ee05c1ee47e08b2f7c1601dda3c2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:34.144771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fadcc7-9a95-48c5-89e3-9db6549eee9e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.145067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fadcc7-9a95-48c5-89e3-9db6549eee9e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.145380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fadcc7-9a95-48c5-89e3-9db6549eee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.200175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-26fadcc7-9a95-48c5-89e3-9db6549eee9e None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:34.201365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26fadcc7-9a95-48c5-89e3-9db6549eee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:34.213942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:34.260407 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1371/2753] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:34.268769 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104841a-7be3-4d5c-8581-fb82905fe524 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.269142 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104841a-7be3-4d5c-8581-fb82905fe524 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.269500 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104841a-7be3-4d5c-8581-fb82905fe524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.289165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4104841a-7be3-4d5c-8581-fb82905fe524 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:34.290383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4104841a-7be3-4d5c-8581-fb82905fe524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:34.298880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1383/2754] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:34.303068 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fadcc7-9a95-48c5-89e3-9db6549eee9e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.312593 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fadcc7-9a95-48c5-89e3-9db6549eee9e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.317142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.317827 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.318120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.318402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.319118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:10:34.319426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.321019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.332771 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1372/2755] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:10:34.336691 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104841a-7be3-4d5c-8581-fb82905fe524 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.346548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104841a-7be3-4d5c-8581-fb82905fe524 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.351258 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.351898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.352187 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.352468 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.353164 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.355095 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.379751 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1384/2756] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:34 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:10:34.383886 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.394667 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ce87e-fb45-4bcd-93ed-53313d7381b8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.449519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.450756 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.451045 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.451327 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.452002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.453945 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.476048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1373/2757] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:34 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:10:34.480671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.492148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cbb1-9a73-4cbd-975c-9036b45307eb admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.496889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.497547 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.497875 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.498161 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.498890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.500491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.510910 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1385/2758] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:34.515274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.525142 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d756c5-51ab-4693-b4d6-21365d49a4a6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.530375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3301a2e-2f50-4e4e-a516-2574f2b6d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.531033 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3301a2e-2f50-4e4e-a516-2574f2b6d5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.531323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3301a2e-2f50-4e4e-a516-2574f2b6d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.531600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3301a2e-2f50-4e4e-a516-2574f2b6d5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.532317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3301a2e-2f50-4e4e-a516-2574f2b6d5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.533942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3301a2e-2f50-4e4e-a516-2574f2b6d5f2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.544181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1374/2759] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:34.548203 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.558440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50e6fa-269c-49d4-87ad-937d293032c6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.563334 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.564361 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.564655 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.564937 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] PATH_INFO: `/v3/projects/7cdae6adee7a418692d4ab3c71e87b3d/users/1d5677841ad44832ae8a9d7ada66728b/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.579597 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdae6adee7a418692d4ab3c71e87b3d, user_id=1d5677841ad44832ae8a9d7ada66728b, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.582639 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.584817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:34.598308 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1386/2760] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:34 2022] PUT /identity/v3/projects/7cdae6adee7a418692d4ab3c71e87b3d/users/1d5677841ad44832ae8a9d7ada66728b/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:10:34.603300 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c4c3-19b8-4ff3-9c32-ebfa39d42b12 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.603785 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c4c3-19b8-4ff3-9c32-ebfa39d42b12 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.603903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c4c3-19b8-4ff3-9c32-ebfa39d42b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.622557 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-da68c4c3-19b8-4ff3-9c32-ebfa39d42b12 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:34.623752 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-da68c4c3-19b8-4ff3-9c32-ebfa39d42b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:34.680275 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1375/2761] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:34.689618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:34.691330 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:34.748211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde249f-cf3a-4250-801d-7ebdbb0fc96d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:34.751881 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:34.752520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:34.752809 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:34.753090 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:34.762026 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:34.763399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:34.772595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1387/2762] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:35.383101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62ed8f-6c25-485a-a7b0-b101ea940268 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:35.383394 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62ed8f-6c25-485a-a7b0-b101ea940268 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:35.383681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62ed8f-6c25-485a-a7b0-b101ea940268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:35.414999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3a62ed8f-6c25-485a-a7b0-b101ea940268 None None] MFA Rules not processed for user `1d5677841ad44832ae8a9d7ada66728b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:35.416583 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3a62ed8f-6c25-485a-a7b0-b101ea940268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:35.430410 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:35.489559 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1376/2763] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:35.494175 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:35.503900 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6cbd-cf9c-4066-b334-6cafdc49db46 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:35.508522 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:35.509169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:35.509457 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:35.509738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:35.510471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:35.512364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:35.539704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1388/2764] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:35 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:35.544328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62ed8f-6c25-485a-a7b0-b101ea940268 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:35.555143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62ed8f-6c25-485a-a7b0-b101ea940268 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:35.611008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:35.611631 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:35.611868 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:35.612144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:35.612819 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:35.614902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:35.634573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1377/2765] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:35 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:10:35.638607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:35.648952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a453c-6ade-4137-b693-6facde453528 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:35.654219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:35.654874 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:35.655163 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:35.655440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:35.656168 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:35.657774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:35.668401 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1389/2766] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:35.672948 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:35.682658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20affa91-c81b-4332-b0e5-6f6207789b84 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:35.687212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:35.688088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:35.688373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:35.688655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] PATH_INFO: `/v3/projects/22f2cebd14e74ba1b2fb60c1ef88a714/users/544eecc9fd704b2eb3c1d8369e1cfb6a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:35.703187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f2cebd14e74ba1b2fb60c1ef88a714, user_id=544eecc9fd704b2eb3c1d8369e1cfb6a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:35.706087 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:35.718892 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1378/2767] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:35 2022] PUT /identity/v3/projects/22f2cebd14e74ba1b2fb60c1ef88a714/users/544eecc9fd704b2eb3c1d8369e1cfb6a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:35.722665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:35.732750 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f752874-3e04-4eee-a3d1-b86b57773944 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:35.787138 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991947e-d466-44bf-b7d1-8341a594fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:35.787784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991947e-d466-44bf-b7d1-8341a594fc88 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:35.788067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991947e-d466-44bf-b7d1-8341a594fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:35.788595 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991947e-d466-44bf-b7d1-8341a594fc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:35.789304 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991947e-d466-44bf-b7d1-8341a594fc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:35.790916 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991947e-d466-44bf-b7d1-8341a594fc88 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:35.800982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1390/2768] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:35.805177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:35.815252 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03848665-c28a-4363-846c-64a042c26185 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:35.820212 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:35.821097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:35.821412 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:35.821695 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] PATH_INFO: `/v3/projects/22f2cebd14e74ba1b2fb60c1ef88a714/users/544eecc9fd704b2eb3c1d8369e1cfb6a/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:35.823704 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f2cebd14e74ba1b2fb60c1ef88a714, user_id=544eecc9fd704b2eb3c1d8369e1cfb6a, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:35.826902 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:35.837165 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1379/2769] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:35 2022] PUT /identity/v3/projects/22f2cebd14e74ba1b2fb60c1ef88a714/users/544eecc9fd704b2eb3c1d8369e1cfb6a/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:36.462460 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec932-dd0e-4f74-8cd1-81bec5c1d923 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:36.462759 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec932-dd0e-4f74-8cd1-81bec5c1d923 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:36.463045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec932-dd0e-4f74-8cd1-81bec5c1d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:36.491120 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-af1ec932-dd0e-4f74-8cd1-81bec5c1d923 None None] MFA Rules not processed for user `544eecc9fd704b2eb3c1d8369e1cfb6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:36.492337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-af1ec932-dd0e-4f74-8cd1-81bec5c1d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:36.543180 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:36.566662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1391/2770] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:37.514860 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:37.516612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:37.571855 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec932-dd0e-4f74-8cd1-81bec5c1d923 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:37.596800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268bd7-7d05-4d7c-b3e5-6dfc3c8fbf8e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:37.601995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:37.602645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:37.602934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:37.603214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:37.605040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:37.616529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:37.618189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:37.623021 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:37.629952 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1380/2771] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:37.639165 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec932-dd0e-4f74-8cd1-81bec5c1d923 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:37.647803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:37.648712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:37.649008 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:37.649321 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] PATH_INFO: `/v3/users/1d5677841ad44832ae8a9d7ada66728b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:37.650617 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5677841ad44832ae8a9d7ada66728b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:37.652543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:37.698854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5677841ad44832ae8a9d7ada66728b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:37.706303 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5677841ad44832ae8a9d7ada66728b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:37.706971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5677841ad44832ae8a9d7ada66728b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:37.714894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5677841ad44832ae8a9d7ada66728b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:37.715572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5677841ad44832ae8a9d7ada66728b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:37.732779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1392/2772] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:37 2022] DELETE /identity/v3/users/1d5677841ad44832ae8a9d7ada66728b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:10:37.910435 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:37.921323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00166ab9-4217-4d0b-a093-020d9750361b service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:37.977547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:37.978369 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:37.978651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:37.978931 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] PATH_INFO: `/v3/projects/7cdae6adee7a418692d4ab3c71e87b3d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:37.980088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdae6adee7a418692d4ab3c71e87b3d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:37.982007 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.027237 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdae6adee7a418692d4ab3c71e87b3d', 'request_id': 'req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.033213 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdae6adee7a418692d4ab3c71e87b3d', 'request_id': 'req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.039171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdae6adee7a418692d4ab3c71e87b3d', 'request_id': 'req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.051869 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] The token cache is being invalidate because project 7cdae6adee7a418692d4ab3c71e87b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:38.052158 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.052800 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.054354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1381/2773] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:37 2022] DELETE /identity/v3/projects/7cdae6adee7a418692d4ab3c71e87b3d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:38.058332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.060346 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:38.073000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b3459-be91-4d1f-b730-6a9275aed684 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.127949 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.128804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.129082 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.129354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] PATH_INFO: `/v3/users/544eecc9fd704b2eb3c1d8369e1cfb6a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.130540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544eecc9fd704b2eb3c1d8369e1cfb6a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.132434 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.136982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:38.185710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544eecc9fd704b2eb3c1d8369e1cfb6a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.192549 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544eecc9fd704b2eb3c1d8369e1cfb6a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.193217 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544eecc9fd704b2eb3c1d8369e1cfb6a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.200023 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544eecc9fd704b2eb3c1d8369e1cfb6a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.200738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b5219441-6ef8-44d7-be5e-49a8d38faf24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544eecc9fd704b2eb3c1d8369e1cfb6a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.217390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1393/2774] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:38 2022] DELETE /identity/v3/users/544eecc9fd704b2eb3c1d8369e1cfb6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:38.393581 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.394773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:38.408129 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5216bd5-1aad-4423-a7b1-e6d3aedf7510 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.464546 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.465983 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.466278 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.466566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] PATH_INFO: `/v3/projects/22f2cebd14e74ba1b2fb60c1ef88a714` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.467744 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f2cebd14e74ba1b2fb60c1ef88a714)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.469655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.505512 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:38.520395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f2cebd14e74ba1b2fb60c1ef88a714', 'request_id': 'req-fd465433-a960-4ff8-84dd-c63c53143267'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.526438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f2cebd14e74ba1b2fb60c1ef88a714', 'request_id': 'req-fd465433-a960-4ff8-84dd-c63c53143267'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.532427 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f2cebd14e74ba1b2fb60c1ef88a714', 'request_id': 'req-fd465433-a960-4ff8-84dd-c63c53143267'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.545888 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] The token cache is being invalidate because project 22f2cebd14e74ba1b2fb60c1ef88a714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:38.546178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.546799 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fd465433-a960-4ff8-84dd-c63c53143267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:38.548371 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1382/2775] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:38 2022] DELETE /identity/v3/projects/22f2cebd14e74ba1b2fb60c1ef88a714 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:38.553355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ea88d-9611-47e3-8698-fc30768507ef None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.553709 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ea88d-9611-47e3-8698-fc30768507ef None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.554044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ea88d-9611-47e3-8698-fc30768507ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.571928 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0d9ea88d-9611-47e3-8698-fc30768507ef None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:38.573130 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0d9ea88d-9611-47e3-8698-fc30768507ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:38.631677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1394/2776] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:38.639297 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf540e5-1dc3-4007-b1ea-93ceea6e105f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.639594 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf540e5-1dc3-4007-b1ea-93ceea6e105f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.639880 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf540e5-1dc3-4007-b1ea-93ceea6e105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.658299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dcf540e5-1dc3-4007-b1ea-93ceea6e105f None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:38.659500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dcf540e5-1dc3-4007-b1ea-93ceea6e105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:38.667585 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1383/2777] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:38.672151 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ea88d-9611-47e3-8698-fc30768507ef None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.681870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ea88d-9611-47e3-8698-fc30768507ef None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.686449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.687098 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.687388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.687670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.688397 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:10:38.688712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.690349 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.701915 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1395/2778] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:10:38.706166 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf540e5-1dc3-4007-b1ea-93ceea6e105f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.715196 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf540e5-1dc3-4007-b1ea-93ceea6e105f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.720255 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.720890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.721175 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.721450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.722169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.724046 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.748604 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1384/2779] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:38 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:38.752583 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.762971 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118591e-29be-439a-9785-e97bb1a4b251 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.819038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.819632 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.819921 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.820324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.821033 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.823290 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.839314 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:38.846034 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1396/2780] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:38 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:38.849250 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.859408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3e54-f22d-4230-81e3-25f3c4cd51b4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.864004 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.864660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.864949 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.865230 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.865988 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.867591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.877724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1385/2781] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:38.881431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.893038 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc9e73-72e2-4036-86f5-144815343634 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.898611 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069415c5-046d-46a8-a193-27e5b9f2b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.899274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069415c5-046d-46a8-a193-27e5b9f2b4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.899561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069415c5-046d-46a8-a193-27e5b9f2b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.899840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069415c5-046d-46a8-a193-27e5b9f2b4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.900566 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069415c5-046d-46a8-a193-27e5b9f2b4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.902267 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069415c5-046d-46a8-a193-27e5b9f2b4a4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.915193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1397/2782] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:10:38.919568 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:38.929492 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e953f2-d0fb-48c1-aac5-ea08f87561d7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:38.934151 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:38.935027 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.935312 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.935589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] PATH_INFO: `/v3/projects/49100485b62444429cf47927dd6a2e3b/users/fdbdbe35353c49e2aead669c8a2b3a81/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:38.950314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49100485b62444429cf47927dd6a2e3b, user_id=fdbdbe35353c49e2aead669c8a2b3a81, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:38.952943 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:38.966132 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1386/2783] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:38 2022] PUT /identity/v3/projects/49100485b62444429cf47927dd6a2e3b/users/fdbdbe35353c49e2aead669c8a2b3a81/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:38.977528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb60f01-a9fd-4ec1-979b-15d31c4fbc07 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:38.977858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb60f01-a9fd-4ec1-979b-15d31c4fbc07 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:38.978148 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb60f01-a9fd-4ec1-979b-15d31c4fbc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.004089 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6bb60f01-a9fd-4ec1-979b-15d31c4fbc07 None None] MFA Rules not processed for user `fdbdbe35353c49e2aead669c8a2b3a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:39.005277 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6bb60f01-a9fd-4ec1-979b-15d31c4fbc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:39.067524 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1398/2784] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:39.072019 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.132254 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fd21d-61fe-4c7a-aff9-0d8a7e3c7f54 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.136837 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.138056 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.138345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.138623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.139295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.141226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.165643 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1387/2785] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:39 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:39.169609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb60f01-a9fd-4ec1-979b-15d31c4fbc07 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.180157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb60f01-a9fd-4ec1-979b-15d31c4fbc07 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.236729 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.237389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.237690 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.237980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.238668 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.240615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.260854 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1399/2786] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:39 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:39.265493 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.275681 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ccf23-e14e-4f97-938e-0fa068779dca admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.280862 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.281511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.281849 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.282136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.282855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.284477 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.296737 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1388/2787] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:39.301264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.311074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8c2b-547a-4850-a274-01712e64e96b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.315667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.316530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.316816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.317094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] PATH_INFO: `/v3/projects/b5fb840e787c4ff1be136d331341b1c6/users/28f4ac983bf94c3cbc4c626a10762397/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.332065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fb840e787c4ff1be136d331341b1c6, user_id=28f4ac983bf94c3cbc4c626a10762397, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.334680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.347540 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1400/2788] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:39 2022] PUT /identity/v3/projects/b5fb840e787c4ff1be136d331341b1c6/users/28f4ac983bf94c3cbc4c626a10762397/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:10:39.351514 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.362069 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b8dd-a3d8-4c5f-b582-3108e45ee825 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.387073 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:39.419553 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153656c-eb76-4a80-a502-ff9b959428a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.420210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153656c-eb76-4a80-a502-ff9b959428a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.420491 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153656c-eb76-4a80-a502-ff9b959428a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.420763 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153656c-eb76-4a80-a502-ff9b959428a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.421464 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153656c-eb76-4a80-a502-ff9b959428a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.423101 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153656c-eb76-4a80-a502-ff9b959428a8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.432469 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1389/2789] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:39.436531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.446684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c0de-5e27-4036-992e-1010deaea52c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.451276 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.452146 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.452433 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.452710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] PATH_INFO: `/v3/projects/b5fb840e787c4ff1be136d331341b1c6/users/28f4ac983bf94c3cbc4c626a10762397/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.454689 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fb840e787c4ff1be136d331341b1c6, user_id=28f4ac983bf94c3cbc4c626a10762397, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.457326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.467762 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1401/2790] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:39 2022] PUT /identity/v3/projects/b5fb840e787c4ff1be136d331341b1c6/users/28f4ac983bf94c3cbc4c626a10762397/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:39.477971 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f03b-c326-4c0c-b625-f9b83aabe762 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.478348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f03b-c326-4c0c-b625-f9b83aabe762 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.478645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f03b-c326-4c0c-b625-f9b83aabe762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.505256 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7a19f03b-c326-4c0c-b625-f9b83aabe762 None None] MFA Rules not processed for user `28f4ac983bf94c3cbc4c626a10762397`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:39.506486 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7a19f03b-c326-4c0c-b625-f9b83aabe762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:39.572482 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1390/2791] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:39.584004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.585633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:39.619556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:39.664658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0175f1b-505e-4be3-91eb-19771bece7ac admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.668310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.668952 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.669240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.669523 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.678561 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.680015 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.689332 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1402/2792] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:39.758350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f03b-c326-4c0c-b625-f9b83aabe762 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:39.768366 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f03b-c326-4c0c-b625-f9b83aabe762 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:39.771969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca3fe-5565-468a-9917-05d7f24b6673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:39.772603 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca3fe-5565-468a-9917-05d7f24b6673 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:39.772891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca3fe-5565-468a-9917-05d7f24b6673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:39.773170 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca3fe-5565-468a-9917-05d7f24b6673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:39.829093 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca3fe-5565-468a-9917-05d7f24b6673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:39.830633 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca3fe-5565-468a-9917-05d7f24b6673 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:39.839345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1391/2793] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:42.517702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:42.580270 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c0bf-fe9d-421c-ab30-857b6e37bbd9 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:42.584767 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:42.585621 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:42.585933 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:42.586213 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] PATH_INFO: `/v3/users/fdbdbe35353c49e2aead669c8a2b3a81` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:42.587389 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbdbe35353c49e2aead669c8a2b3a81)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:42.589284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:42.634479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbdbe35353c49e2aead669c8a2b3a81'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:42.641174 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbdbe35353c49e2aead669c8a2b3a81'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:42.641858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbdbe35353c49e2aead669c8a2b3a81'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:42.648834 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbdbe35353c49e2aead669c8a2b3a81'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:42.649451 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbdbe35353c49e2aead669c8a2b3a81'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:42.666596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1403/2794] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:42 2022] DELETE /identity/v3/users/fdbdbe35353c49e2aead669c8a2b3a81 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:42.671683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:42.672144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:42.672306 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:42.689543 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:42.690775 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:42.733211 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:42.748959 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1392/2795] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:42.758577 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:42.760040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:42.795283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:42.818868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a696e9-9a3d-40cf-8f8a-eef3a3cda92e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:42.822532 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:42.823169 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:42.823456 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:42.823738 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:42.832664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:42.834134 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:42.843630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1404/2796] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:43.120733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:43.122208 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:43.134117 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a891cf-4a67-4eb2-ab20-66ee9c826873 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:43.138742 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:43.139600 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:43.139915 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:43.140190 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] PATH_INFO: `/v3/projects/49100485b62444429cf47927dd6a2e3b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:43.141360 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49100485b62444429cf47927dd6a2e3b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:43.143322 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:43.190397 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49100485b62444429cf47927dd6a2e3b', 'request_id': 'req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.196447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49100485b62444429cf47927dd6a2e3b', 'request_id': 'req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.202355 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49100485b62444429cf47927dd6a2e3b', 'request_id': 'req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.214106 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] The token cache is being invalidate because project 49100485b62444429cf47927dd6a2e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:43.214395 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.215022 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.217070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1393/2797] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:43 2022] DELETE /identity/v3/projects/49100485b62444429cf47927dd6a2e3b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:43.221004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:43.230673 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772bc77-1cd3-49eb-af10-681f5d889ba4 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:43.288775 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:43.289663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:43.289982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:43.290264 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] PATH_INFO: `/v3/users/28f4ac983bf94c3cbc4c626a10762397` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:43.291471 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f4ac983bf94c3cbc4c626a10762397)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:43.293393 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:43.342443 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f4ac983bf94c3cbc4c626a10762397'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.349463 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f4ac983bf94c3cbc4c626a10762397'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.350157 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f4ac983bf94c3cbc4c626a10762397'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.358765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f4ac983bf94c3cbc4c626a10762397'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.359440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-46275f8f-cbc9-4395-93da-723d12d5cd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f4ac983bf94c3cbc4c626a10762397'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.379417 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1405/2798] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:43 2022] DELETE /identity/v3/users/28f4ac983bf94c3cbc4c626a10762397 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:43.650924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:43.652468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:43.665611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393bff-dbdf-4d55-89ce-a3711a3ac9c3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:43.723026 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:43.723889 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:43.724180 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:43.724513 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] PATH_INFO: `/v3/projects/b5fb840e787c4ff1be136d331341b1c6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:43.725664 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5fb840e787c4ff1be136d331341b1c6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:43.727669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:43.773125 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5fb840e787c4ff1be136d331341b1c6', 'request_id': 'req-528584a7-7adf-4f01-8250-5e4265f1a934'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.779012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5fb840e787c4ff1be136d331341b1c6', 'request_id': 'req-528584a7-7adf-4f01-8250-5e4265f1a934'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.784385 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5fb840e787c4ff1be136d331341b1c6', 'request_id': 'req-528584a7-7adf-4f01-8250-5e4265f1a934'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.797506 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] The token cache is being invalidate because project b5fb840e787c4ff1be136d331341b1c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:43.797814 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.798432 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-528584a7-7adf-4f01-8250-5e4265f1a934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:43.800209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1394/2799] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:43 2022] DELETE /identity/v3/projects/b5fb840e787c4ff1be136d331341b1c6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:43.805052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10893c-cacb-44f4-b8d2-b0029fef0a6d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:43.805575 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10893c-cacb-44f4-b8d2-b0029fef0a6d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:43.805667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10893c-cacb-44f4-b8d2-b0029fef0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:43.823301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9b10893c-cacb-44f4-b8d2-b0029fef0a6d None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:43.824498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9b10893c-cacb-44f4-b8d2-b0029fef0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:43.873491 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:43.886031 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1406/2800] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:43.893690 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6984-711e-4d6a-bab1-93a8066057cd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:43.894034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6984-711e-4d6a-bab1-93a8066057cd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:43.894321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6984-711e-4d6a-bab1-93a8066057cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:43.900570 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:43.915126 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-58fe6984-711e-4d6a-bab1-93a8066057cd None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:43.916321 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-58fe6984-711e-4d6a-bab1-93a8066057cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:43.924687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1395/2801] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:43.928748 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10893c-cacb-44f4-b8d2-b0029fef0a6d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:43.938261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10893c-cacb-44f4-b8d2-b0029fef0a6d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:43.942779 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:43.943424 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:43.943712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:43.943998 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:43.944723 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:10:43.945032 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:43.946683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:43.958050 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1407/2802] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:10:43.963496 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6984-711e-4d6a-bab1-93a8066057cd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:43.973314 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6984-711e-4d6a-bab1-93a8066057cd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:43.978127 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:43.978758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:43.979048 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:43.979329 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:43.980028 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:43.982580 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.007539 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1396/2803] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:43 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:44.011658 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.021946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f9258-3785-448d-b2d2-20814ce52b44 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.077560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.078249 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.078541 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.078826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.079506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.081459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.102552 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1408/2804] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:44 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:44.106758 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.116921 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c5087-1a35-429e-96d9-0ae7e22d8a2e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.121488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.122182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.122472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.122753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.123527 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.125118 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.135332 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1397/2805] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 10:10:44.139598 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.149388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5f74-e94a-46f5-8d42-179925acd07a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.154731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6468c-1f83-4b27-b259-d0f22aecb25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.155380 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6468c-1f83-4b27-b259-d0f22aecb25a admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.155669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6468c-1f83-4b27-b259-d0f22aecb25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.155951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6468c-1f83-4b27-b259-d0f22aecb25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.156731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6468c-1f83-4b27-b259-d0f22aecb25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.158360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6468c-1f83-4b27-b259-d0f22aecb25a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.168469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1409/2806] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:44.172418 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.182271 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c3c64-283b-4ad3-af0d-f467fa1dc750 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.186865 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.187731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.188017 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.188296 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] PATH_INFO: `/v3/projects/665ca24d5bb645c29bd9123ddbd97339/users/86ebfca3ffb94341ab184e490b4c17f5/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.203113 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=665ca24d5bb645c29bd9123ddbd97339, user_id=86ebfca3ffb94341ab184e490b4c17f5, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.205780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.218910 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1398/2807] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:44 2022] PUT /identity/v3/projects/665ca24d5bb645c29bd9123ddbd97339/users/86ebfca3ffb94341ab184e490b4c17f5/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:44.228885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef0ab-d092-426e-b501-6677b5eb5f1b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.229121 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef0ab-d092-426e-b501-6677b5eb5f1b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.229421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef0ab-d092-426e-b501-6677b5eb5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.254959 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-748ef0ab-d092-426e-b501-6677b5eb5f1b None None] MFA Rules not processed for user `86ebfca3ffb94341ab184e490b4c17f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:44.256129 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-748ef0ab-d092-426e-b501-6677b5eb5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:44.319953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1410/2808] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:44.324447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.385878 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3756f65-5edf-4437-899e-f523a6d368eb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.391110 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.391768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.392058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.392341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.393041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.395005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.419611 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1399/2809] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:44 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:44.423631 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef0ab-d092-426e-b501-6677b5eb5f1b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.434894 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef0ab-d092-426e-b501-6677b5eb5f1b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.481232 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:44.491359 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.492020 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.492307 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.492588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.493284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.495223 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.524341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1411/2810] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:44 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:44.528450 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.538972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90667361-a288-4640-8d6d-e42501ad415b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.543705 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.544363 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.544654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.544939 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.545657 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.547294 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.557617 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1400/2811] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:44.561776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.571654 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702303c5-5986-461a-84f3-f3807ce08b17 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.576879 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6fec9-91b4-4c3b-b48e-527ea43b3540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.577530 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6fec9-91b4-4c3b-b48e-527ea43b3540 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.577859 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6fec9-91b4-4c3b-b48e-527ea43b3540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.578145 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6fec9-91b4-4c3b-b48e-527ea43b3540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.578903 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6fec9-91b4-4c3b-b48e-527ea43b3540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.580483 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6fec9-91b4-4c3b-b48e-527ea43b3540 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.590313 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1412/2812] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:44.594138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.604341 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3ce4-2568-4f69-a218-ac4d5a526b93 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.608992 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.609896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.610214 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.610498 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] PATH_INFO: `/v3/projects/52b04814fec04935bd97eae769be6afa/users/f3aca326d69b4a1781d7216e6188db3b/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.625227 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b04814fec04935bd97eae769be6afa, user_id=f3aca326d69b4a1781d7216e6188db3b, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.627903 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.641023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1401/2813] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:44 2022] PUT /identity/v3/projects/52b04814fec04935bd97eae769be6afa/users/f3aca326d69b4a1781d7216e6188db3b/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:10:44.651360 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13280239-5f8c-421a-961b-183e0b478c0c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.651657 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13280239-5f8c-421a-961b-183e0b478c0c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.651943 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13280239-5f8c-421a-961b-183e0b478c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.677731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-13280239-5f8c-421a-961b-183e0b478c0c None None] MFA Rules not processed for user `f3aca326d69b4a1781d7216e6188db3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:44.678951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-13280239-5f8c-421a-961b-183e0b478c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:44.742498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1413/2814] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:44.747561 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.795478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:44.810181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bff3f4-a83f-4d25-9023-82542ae032af admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.814859 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.815519 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.815806 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.816088 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.816768 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.818711 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.843828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1402/2815] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:44 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:44.847803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13280239-5f8c-421a-961b-183e0b478c0c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.858755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13280239-5f8c-421a-961b-183e0b478c0c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.914035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.914704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.914994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.915280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.915997 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.917934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.939338 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1414/2816] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:44 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:44.943795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.954497 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989232-01df-4ab5-a927-c6dffb2fc74b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.959107 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.959764 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.960051 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.960334 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:44.961050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:44.962723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:44.973281 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1403/2817] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:44.977399 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:44.987839 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c475f1c-c325-4a62-b584-3d3306cb1aab admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:44.992479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:44.993418 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:44.993642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:44.993957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] PATH_INFO: `/v3/projects/aa5097e8d6f94789801cbf81027b7a0c/users/467738db14334e75832913c55fe5b825/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:45.009329 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5097e8d6f94789801cbf81027b7a0c, user_id=467738db14334e75832913c55fe5b825, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:45.012062 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:45.024477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1415/2818] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:44 2022] PUT /identity/v3/projects/aa5097e8d6f94789801cbf81027b7a0c/users/467738db14334e75832913c55fe5b825/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:45.028547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:45.038904 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc05f08-fb64-41da-b255-c0ced3991465 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:45.095172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52d6e-10f4-437f-a4b6-701f40f85a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:45.095844 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52d6e-10f4-437f-a4b6-701f40f85a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:45.096137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52d6e-10f4-437f-a4b6-701f40f85a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:45.096421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52d6e-10f4-437f-a4b6-701f40f85a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:45.097144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52d6e-10f4-437f-a4b6-701f40f85a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:45.098821 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52d6e-10f4-437f-a4b6-701f40f85a32 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:45.109313 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1404/2819] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:45.113499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:45.124382 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825034a-ad5f-438b-a51c-e6bc28284065 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:45.129045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:45.129989 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:45.130281 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:45.130563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] PATH_INFO: `/v3/projects/aa5097e8d6f94789801cbf81027b7a0c/users/467738db14334e75832913c55fe5b825/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:45.132544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5097e8d6f94789801cbf81027b7a0c, user_id=467738db14334e75832913c55fe5b825, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:45.135192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:45.145289 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1416/2820] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:45 2022] PUT /identity/v3/projects/aa5097e8d6f94789801cbf81027b7a0c/users/467738db14334e75832913c55fe5b825/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:45.207586 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:45.207884 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:45.208203 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:45.235192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] MFA Rules not processed for user `467738db14334e75832913c55fe5b825`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:45.236387 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:45.304449 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1405/2821] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:45.315324 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:45.317150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:45.331431 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:45.377493 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfec23f-68f0-478b-8022-06e00532040a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:45.381211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:45.381890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:45.382182 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:45.382469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:45.391660 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:45.393094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:45.402469 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1417/2822] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:45.876417 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:45.877845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:45.890178 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4bb04-be1c-4b7e-90f6-44041de9f33c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:45.893773 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:45.894433 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:45.894724 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:45.895008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:45.935783 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:45.951540 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:45.952979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:45.961703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1406/2823] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:49.914219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:49.924225 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b8124-e7ef-4f4e-b5e5-ee6e46f8f7d2 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:49.928155 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c5f9-993f-4a74-9a38-3b31dffceb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:49.928792 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c5f9-993f-4a74-9a38-3b31dffceb9a service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:49.929081 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c5f9-993f-4a74-9a38-3b31dffceb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:49.929364 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c5f9-993f-4a74-9a38-3b31dffceb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:49.987438 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5c5f9-993f-4a74-9a38-3b31dffceb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:49.988790 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5c5f9-993f-4a74-9a38-3b31dffceb9a service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:49.998022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1418/2824] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:52.037037 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:52.110591 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91368d-c133-4284-8dee-00f15fd33b9a service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:52.115199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:52.116067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:52.116357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:52.116640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] PATH_INFO: `/v3/users/86ebfca3ffb94341ab184e490b4c17f5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:52.117846 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ebfca3ffb94341ab184e490b4c17f5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:52.119779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:52.166268 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ebfca3ffb94341ab184e490b4c17f5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.173500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ebfca3ffb94341ab184e490b4c17f5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.174181 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ebfca3ffb94341ab184e490b4c17f5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.182349 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ebfca3ffb94341ab184e490b4c17f5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.182976 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ebfca3ffb94341ab184e490b4c17f5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.199549 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1407/2825] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:52 2022] DELETE /identity/v3/users/86ebfca3ffb94341ab184e490b4c17f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:52.204057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:52.204544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:52.204664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:52.221710 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:52.222930 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:52.281185 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1419/2826] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:52.291001 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:52.292382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:52.350317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30829cf-0e61-4d1e-8f00-7d3a0f3d4cd6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:52.353973 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:52.354619 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:52.354905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:52.355187 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:52.365677 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:52.367182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:52.376890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1408/2827] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:10:52.645556 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:52.647253 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:52.661627 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3637-6416-40f8-b9c2-bbd198a2e9c8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:52.666664 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:52.667543 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:52.667837 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:52.668124 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] PATH_INFO: `/v3/projects/665ca24d5bb645c29bd9123ddbd97339` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:52.669375 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665ca24d5bb645c29bd9123ddbd97339)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:52.671341 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:52.719421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:52.720865 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665ca24d5bb645c29bd9123ddbd97339', 'request_id': 'req-6ac8fba2-7f75-407c-b2b0-719b511a1210'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.727063 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665ca24d5bb645c29bd9123ddbd97339', 'request_id': 'req-6ac8fba2-7f75-407c-b2b0-719b511a1210'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.734156 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665ca24d5bb645c29bd9123ddbd97339', 'request_id': 'req-6ac8fba2-7f75-407c-b2b0-719b511a1210'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.744960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] The token cache is being invalidate because project 665ca24d5bb645c29bd9123ddbd97339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:52.745248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.745895 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.747954 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1420/2828] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:52 2022] DELETE /identity/v3/projects/665ca24d5bb645c29bd9123ddbd97339 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:52.751874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:52.757990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:52.762642 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21840f9-f643-4357-9dab-55fc3c227a73 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:52.825468 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:52.826269 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:52.826555 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:52.826828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] PATH_INFO: `/v3/users/f3aca326d69b4a1781d7216e6188db3b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:52.828005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3aca326d69b4a1781d7216e6188db3b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:52.829970 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:52.876551 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3aca326d69b4a1781d7216e6188db3b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.883475 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3aca326d69b4a1781d7216e6188db3b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.884139 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3aca326d69b4a1781d7216e6188db3b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.893731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3aca326d69b4a1781d7216e6188db3b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.894488 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3aca326d69b4a1781d7216e6188db3b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:52.915919 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1409/2829] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:52 2022] DELETE /identity/v3/users/f3aca326d69b4a1781d7216e6188db3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:53.185802 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:53.187237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:53.199826 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8fba2-7f75-407c-b2b0-719b511a1210 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:53.268776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:53.269642 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:53.269973 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:53.270255 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] PATH_INFO: `/v3/projects/52b04814fec04935bd97eae769be6afa` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:53.271440 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b04814fec04935bd97eae769be6afa)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:53.273337 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:53.319525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b04814fec04935bd97eae769be6afa', 'request_id': 'req-a4d27708-c9a5-4604-bf2e-9635aad9823a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.324969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b04814fec04935bd97eae769be6afa', 'request_id': 'req-a4d27708-c9a5-4604-bf2e-9635aad9823a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.332049 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b04814fec04935bd97eae769be6afa', 'request_id': 'req-a4d27708-c9a5-4604-bf2e-9635aad9823a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.342821 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] The token cache is being invalidate because project 52b04814fec04935bd97eae769be6afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:53.343101 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.343720 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.345219 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1421/2830] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:53 2022] DELETE /identity/v3/projects/52b04814fec04935bd97eae769be6afa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:53.349241 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:53.350779 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:53.363874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e540f1-1e34-4913-aa54-c9c96773ee09 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:53.420613 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:53.421528 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:53.421848 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:53.422134 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] PATH_INFO: `/v3/users/467738db14334e75832913c55fe5b825` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:53.423323 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467738db14334e75832913c55fe5b825)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:53.425380 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:53.452730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:53.472257 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467738db14334e75832913c55fe5b825'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.479054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467738db14334e75832913c55fe5b825'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.479714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467738db14334e75832913c55fe5b825'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.488458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467738db14334e75832913c55fe5b825'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.489098 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ff46003-0f11-4bb7-b30b-3e79ae018032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467738db14334e75832913c55fe5b825'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.506299 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1410/2831] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:10:53 2022] DELETE /identity/v3/users/467738db14334e75832913c55fe5b825 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:10:53.776539 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:53.778017 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:53.791671 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d27708-c9a5-4604-bf2e-9635aad9823a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:53.850670 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:53.851531 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:53.851815 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:53.852091 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] PATH_INFO: `/v3/projects/aa5097e8d6f94789801cbf81027b7a0c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:53.853284 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5097e8d6f94789801cbf81027b7a0c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:53.855214 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:53.863390 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:53.901366 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5097e8d6f94789801cbf81027b7a0c', 'request_id': 'req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.906669 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5097e8d6f94789801cbf81027b7a0c', 'request_id': 'req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.915988 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5097e8d6f94789801cbf81027b7a0c', 'request_id': 'req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.930765 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] The token cache is being invalidate because project aa5097e8d6f94789801cbf81027b7a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:10:53.931052 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.931694 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-98cd9d75-24d4-4797-b9a3-9cf73c24a43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:10:53.933237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1422/2832] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:10:53 2022] DELETE /identity/v3/projects/aa5097e8d6f94789801cbf81027b7a0c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:10:53.939696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378751ca-c05c-437a-bfb3-fbfbdb45e513 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:53.939990 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378751ca-c05c-437a-bfb3-fbfbdb45e513 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:53.940273 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378751ca-c05c-437a-bfb3-fbfbdb45e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:53.957792 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-378751ca-c05c-437a-bfb3-fbfbdb45e513 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:53.958977 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-378751ca-c05c-437a-bfb3-fbfbdb45e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:54.016377 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1411/2833] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:54.024776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2ab29-e631-4d49-a4fd-62179cddc4b7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.025065 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2ab29-e631-4d49-a4fd-62179cddc4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.025345 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2ab29-e631-4d49-a4fd-62179cddc4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.044212 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f7d2ab29-e631-4d49-a4fd-62179cddc4b7 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:54.045383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f7d2ab29-e631-4d49-a4fd-62179cddc4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:54.053029 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1423/2834] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:54.056995 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378751ca-c05c-437a-bfb3-fbfbdb45e513 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:54.066755 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378751ca-c05c-437a-bfb3-fbfbdb45e513 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:54.072226 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:54.072895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.073184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.073466 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.074867 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:10:54.075206 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:54.076807 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:54.088696 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1412/2835] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:10:54.093822 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2ab29-e631-4d49-a4fd-62179cddc4b7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:54.103240 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2ab29-e631-4d49-a4fd-62179cddc4b7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:54.108596 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:54.109237 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.109516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.109817 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.110520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:54.112702 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:54.137831 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1424/2836] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:10:54 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:54.142050 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:54.152121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072ba5-a5a5-4673-831f-70230d1fcf2d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:54.206622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:54.207282 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.207565 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.207839 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.208520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:54.210457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:54.232144 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1413/2837] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:10:54 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:10:54.236201 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:54.246665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9e883-82f7-4274-bf34-c4a52d52b80d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:54.251354 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:54.252001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.252283 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.252560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.253278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:54.254892 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:54.265994 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1425/2838] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:54.269774 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:54.279836 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27580788-e36d-4506-bc0d-64a05f394a7b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:54.284440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ab8ae-b1fe-4b6a-8d1e-42c9dc8286b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:54.285089 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab8ae-b1fe-4b6a-8d1e-42c9dc8286b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.285373 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab8ae-b1fe-4b6a-8d1e-42c9dc8286b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.285652 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab8ae-b1fe-4b6a-8d1e-42c9dc8286b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.286402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ab8ae-b1fe-4b6a-8d1e-42c9dc8286b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:54.288012 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ab8ae-b1fe-4b6a-8d1e-42c9dc8286b8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:54.298162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1414/2839] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:10:54.302331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:54.312867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78bb6a-dfe0-48a8-a337-d62cf49de81d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:54.317453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:54.318444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.318763 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.319056 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] PATH_INFO: `/v3/projects/4114f654fb7a45d39926b16baa2846bd/users/90ef902de0af42959a89bad0d9552149/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.333964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4114f654fb7a45d39926b16baa2846bd, user_id=90ef902de0af42959a89bad0d9552149, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:54.336573 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:54.349477 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1426/2840] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:10:54 2022] PUT /identity/v3/projects/4114f654fb7a45d39926b16baa2846bd/users/90ef902de0af42959a89bad0d9552149/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 10:10:54.361138 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81879b-d661-4005-899a-a5fbec8a0a35 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.361629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81879b-d661-4005-899a-a5fbec8a0a35 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.361734 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81879b-d661-4005-899a-a5fbec8a0a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.380111 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:54.391662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6f81879b-d661-4005-899a-a5fbec8a0a35 None None] MFA Rules not processed for user `90ef902de0af42959a89bad0d9552149`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:10:54.393276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6f81879b-d661-4005-899a-a5fbec8a0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:54.455891 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1415/2841] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:10:54.467231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:10:54.468963 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:10:54.525733 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45c5c3-bbba-4620-b787-534c95729bc2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:10:54.529369 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c620a4-7dc3-49dd-9294-6baa2c44b486 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22cb7c3278594d7a94f3d8c9cae9610a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:10:54.530040 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c620a4-7dc3-49dd-9294-6baa2c44b486 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:10:54.530328 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c620a4-7dc3-49dd-9294-6baa2c44b486 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:10:54.530608 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c620a4-7dc3-49dd-9294-6baa2c44b486 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:10:54.539000 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c620a4-7dc3-49dd-9294-6baa2c44b486 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:10:54.540436 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c620a4-7dc3-49dd-9294-6baa2c44b486 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:10:54.549607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1427/2842] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:10:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:04.453058 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=28 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:04.545886 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:12.046365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81879b-d661-4005-899a-a5fbec8a0a35 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:12.107723 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81879b-d661-4005-899a-a5fbec8a0a35 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:12.112784 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:12.113650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.114569 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.114864 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] PATH_INFO: `/v3/users/90ef902de0af42959a89bad0d9552149` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.116057 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ef902de0af42959a89bad0d9552149)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:12.118011 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:12.162924 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ef902de0af42959a89bad0d9552149'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.169960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ef902de0af42959a89bad0d9552149'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.170622 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ef902de0af42959a89bad0d9552149'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.179533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ef902de0af42959a89bad0d9552149'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.180160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ef902de0af42959a89bad0d9552149'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.196944 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1416/2843] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:11:12 2022] DELETE /identity/v3/users/90ef902de0af42959a89bad0d9552149 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:12.201453 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.201976 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.202092 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.218784 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:12.219978 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:12.277731 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1428/2844] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:12.287874 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:12.289584 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:12.347008 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825201-b099-41b4-a9ff-eb1dd80af307 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:12.350719 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeead53-8af7-4657-8fa7-1a53e6c12574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:12.351368 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeead53-8af7-4657-8fa7-1a53e6c12574 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.351658 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeead53-8af7-4657-8fa7-1a53e6c12574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.351942 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeead53-8af7-4657-8fa7-1a53e6c12574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.362738 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeead53-8af7-4657-8fa7-1a53e6c12574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:12.364136 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeead53-8af7-4657-8fa7-1a53e6c12574 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:12.375500 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1417/2845] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:12.635819 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:12.637626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:12.652094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2b5e4-2af3-4c73-aa9c-7d71a6ed51e1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:12.656816 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:12.657684 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.658009 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.658310 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] PATH_INFO: `/v3/projects/4114f654fb7a45d39926b16baa2846bd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.659560 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4114f654fb7a45d39926b16baa2846bd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:12.661588 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:12.709663 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4114f654fb7a45d39926b16baa2846bd', 'request_id': 'req-eae6ca03-b387-4221-b5e6-8a3444e3e287'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.715166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4114f654fb7a45d39926b16baa2846bd', 'request_id': 'req-eae6ca03-b387-4221-b5e6-8a3444e3e287'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.722778 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4114f654fb7a45d39926b16baa2846bd', 'request_id': 'req-eae6ca03-b387-4221-b5e6-8a3444e3e287'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.734041 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] The token cache is being invalidate because project 4114f654fb7a45d39926b16baa2846bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:11:12.734331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.734956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-eae6ca03-b387-4221-b5e6-8a3444e3e287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:12.737036 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1429/2846] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:11:12 2022] DELETE /identity/v3/projects/4114f654fb7a45d39926b16baa2846bd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:12.741926 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea17a4-24e6-479d-b3bc-84805628d092 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.742222 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea17a4-24e6-479d-b3bc-84805628d092 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.742511 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea17a4-24e6-479d-b3bc-84805628d092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.760182 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-76ea17a4-24e6-479d-b3bc-84805628d092 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:12.761392 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-76ea17a4-24e6-479d-b3bc-84805628d092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:12.777702 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:12.820895 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1418/2847] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:12.828774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0795d4-7ec6-4576-b3e2-83359b7cc601 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.829067 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0795d4-7ec6-4576-b3e2-83359b7cc601 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.829351 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0795d4-7ec6-4576-b3e2-83359b7cc601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.847675 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2d0795d4-7ec6-4576-b3e2-83359b7cc601 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:12.848856 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2d0795d4-7ec6-4576-b3e2-83359b7cc601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:12.856592 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1430/2848] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:12.860554 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea17a4-24e6-479d-b3bc-84805628d092 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:12.870655 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea17a4-24e6-479d-b3bc-84805628d092 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:12.875184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:12.875834 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.876121 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.876404 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.877120 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:11:12.877428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:12.879177 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:12.890712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1419/2849] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:11:12.894878 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0795d4-7ec6-4576-b3e2-83359b7cc601 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:12.903861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0795d4-7ec6-4576-b3e2-83359b7cc601 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:12.908974 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:12.909607 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:12.909934 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:12.910215 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:12.910911 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:12.912798 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:12.937926 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1431/2850] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:11:12 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:11:12.942002 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:12.951730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e243720-ad59-4daf-ad9c-bbda80a95b52 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.007778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.008454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.008739 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.009018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.009700 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.011640 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.036645 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1420/2851] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:11:12 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:11:13.038946 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.051662 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed440a-845a-4f2a-a45a-c241550e685a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.056391 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.057057 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.057350 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.057649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.058388 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.060123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.074620 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1432/2852] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:13.078793 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.089547 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba108ea6-137a-44bd-a097-3eb4d4f83f4a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.094552 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea8749-aa74-4d55-b785-ca3d375a209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.095209 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8749-aa74-4d55-b785-ca3d375a209c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.096023 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8749-aa74-4d55-b785-ca3d375a209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.096303 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8749-aa74-4d55-b785-ca3d375a209c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.097025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea8749-aa74-4d55-b785-ca3d375a209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.098662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea8749-aa74-4d55-b785-ca3d375a209c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.108472 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1421/2853] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:13.113192 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.122956 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021f67-0eb5-41a2-8a13-d1bed6caaefe admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.127498 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.128383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.128651 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.128931 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] PATH_INFO: `/v3/projects/e3e2dcdc9c4f472c8746315f789972de/users/e32b986ac4e44819a1aca29c711e2288/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.144070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e2dcdc9c4f472c8746315f789972de, user_id=e32b986ac4e44819a1aca29c711e2288, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.146734 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.160004 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1433/2854] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:11:13 2022] PUT /identity/v3/projects/e3e2dcdc9c4f472c8746315f789972de/users/e32b986ac4e44819a1aca29c711e2288/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:13.170592 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167e56-0e34-4145-90e9-6749ff488c34 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.170887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167e56-0e34-4145-90e9-6749ff488c34 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.171169 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167e56-0e34-4145-90e9-6749ff488c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.196934 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ac167e56-0e34-4145-90e9-6749ff488c34 None None] MFA Rules not processed for user `e32b986ac4e44819a1aca29c711e2288`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:13.198184 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ac167e56-0e34-4145-90e9-6749ff488c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:13.259728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1422/2855] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:13.264245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.285618 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:13.325995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68af22-b87c-4562-95cb-18e4262ecc53 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.331210 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.331863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.332150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.332430 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.333123 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.335042 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.359626 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1434/2856] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:11:13 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:11:13.363650 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac167e56-0e34-4145-90e9-6749ff488c34 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.374194 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac167e56-0e34-4145-90e9-6749ff488c34 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.386429 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:13.431534 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.432137 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.432426 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.432712 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.433406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.435354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.454320 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1423/2857] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:11:13 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:11:13.458902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.469199 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7741d88-5188-4ba3-99bf-afb509edf89a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.474444 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.475094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.475383 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.475665 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.476396 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.478022 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.488392 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1435/2858] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:13.492119 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.502639 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868894e-52e1-48c1-aa43-95829852fa73 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.507224 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a6084-7a34-4678-8073-c21c36e7a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.507885 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6084-7a34-4678-8073-c21c36e7a6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.508160 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6084-7a34-4678-8073-c21c36e7a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.508438 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6084-7a34-4678-8073-c21c36e7a6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.509152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a6084-7a34-4678-8073-c21c36e7a6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.510778 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a6084-7a34-4678-8073-c21c36e7a6f1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.521034 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1424/2859] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:13.524776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.534590 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb6bb6-42fa-4296-a04d-cbb6b3236c6c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.539449 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.540323 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.540593 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.540868 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] PATH_INFO: `/v3/projects/deefc7ffb7df4b56b2444a5bc47b63ce/users/d85fb84856484351b7f85bf0016102c3/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.555408 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=deefc7ffb7df4b56b2444a5bc47b63ce, user_id=d85fb84856484351b7f85bf0016102c3, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.558070 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.572153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1436/2860] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:11:13 2022] PUT /identity/v3/projects/deefc7ffb7df4b56b2444a5bc47b63ce/users/d85fb84856484351b7f85bf0016102c3/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:13.583741 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229da9c-468c-4031-8400-1f35a5504676 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.584041 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229da9c-468c-4031-8400-1f35a5504676 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.584316 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229da9c-468c-4031-8400-1f35a5504676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.609467 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b229da9c-468c-4031-8400-1f35a5504676 None None] MFA Rules not processed for user `d85fb84856484351b7f85bf0016102c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:13.610714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b229da9c-468c-4031-8400-1f35a5504676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:13.672563 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1425/2861] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:13.676945 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.746708 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc1a8-b830-407d-ae4d-a6869994d9dd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.751272 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.752427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.752714 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.752993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.753683 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.755615 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.780372 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1437/2862] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:11:13 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:11:13.784653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229da9c-468c-4031-8400-1f35a5504676 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.795406 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229da9c-468c-4031-8400-1f35a5504676 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.851219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.851887 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.852176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.852458 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.853143 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.855105 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.875167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1426/2863] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:11:13 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:11:13.879736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.889814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ec66-5a09-4013-937f-2e198c27a8c5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.894343 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.894993 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.895282 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.895565 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.896572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.898198 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.908427 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1438/2864] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:13.912258 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.922219 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362834c-08b9-4beb-805e-ef3078f395ba admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:13.927293 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:13.928159 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:13.928447 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:13.928731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] PATH_INFO: `/v3/projects/e28029cfbffa42e594d691fe11ba3f60/users/98e1288c8e6c4aa3abc5d70e4d20e06e/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:13.940985 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:13.944710 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28029cfbffa42e594d691fe11ba3f60, user_id=98e1288c8e6c4aa3abc5d70e4d20e06e, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:13.947898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:13.961070 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1427/2865] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:11:13 2022] PUT /identity/v3/projects/e28029cfbffa42e594d691fe11ba3f60/users/98e1288c8e6c4aa3abc5d70e4d20e06e/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:13.964890 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:13.974970 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ffb10-f42f-400f-bb8d-dbdb6a385fbf admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:14.016636 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:14.032518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901037a8-04e2-44d4-97cb-9bd788524b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:14.033172 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901037a8-04e2-44d4-97cb-9bd788524b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:14.033459 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901037a8-04e2-44d4-97cb-9bd788524b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:14.033774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901037a8-04e2-44d4-97cb-9bd788524b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:14.034506 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901037a8-04e2-44d4-97cb-9bd788524b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:14.036088 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901037a8-04e2-44d4-97cb-9bd788524b76 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:14.046077 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1439/2866] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:14.051067 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:14.061152 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c56ed-2a6f-4166-a912-dd0c06dfa2ee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:14.066495 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:14.067376 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:14.067666 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:14.067947 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] PATH_INFO: `/v3/projects/e28029cfbffa42e594d691fe11ba3f60/users/98e1288c8e6c4aa3abc5d70e4d20e06e/roles/296e3902a56444e692e58d5eb525a587` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:14.069946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28029cfbffa42e594d691fe11ba3f60, user_id=98e1288c8e6c4aa3abc5d70e4d20e06e, role_id=296e3902a56444e692e58d5eb525a587)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:14.072602 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:14.082714 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1428/2867] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:11:14 2022] PUT /identity/v3/projects/e28029cfbffa42e594d691fe11ba3f60/users/98e1288c8e6c4aa3abc5d70e4d20e06e/roles/296e3902a56444e692e58d5eb525a587 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:14.092572 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:14.092869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:14.093153 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:14.119580 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] MFA Rules not processed for user `98e1288c8e6c4aa3abc5d70e4d20e06e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:14.120828 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:14.190355 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1440/2868] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:14.201494 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:14.203197 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:14.259331 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77916063-39fd-48c3-b96c-a6832b85c68a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:14.262908 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:14.263548 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:14.263828 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:14.264102 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:14.318979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:14.320365 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:14.329171 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1429/2869] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:15.812800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:15.815051 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:15.827016 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fb48b-101d-46f8-a59b-0f8b7e197189 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:15.830870 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:15.831509 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:15.831800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:15.832084 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:15.888880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:15.890326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:15.899520 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1441/2870] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:16.404064 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:16.412728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4fb0-7710-4b3d-b9c2-67d2c5355d4f service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:16.416637 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516e8f0-09d4-415f-876f-fac644378466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:16.417276 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e8f0-09d4-415f-876f-fac644378466 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:16.417567 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e8f0-09d4-415f-876f-fac644378466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:16.417899 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e8f0-09d4-415f-876f-fac644378466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:16.427280 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516e8f0-09d4-415f-876f-fac644378466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:16.428651 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516e8f0-09d4-415f-876f-fac644378466 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:16.437999 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1430/2871] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:20.262727 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:20.324699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de0c79-b281-4a38-a47a-81a61f82eb3a service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:20.329181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:20.330602 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:20.330880 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:20.331150 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] PATH_INFO: `/v3/users/e32b986ac4e44819a1aca29c711e2288` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:20.332322 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32b986ac4e44819a1aca29c711e2288)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:20.334268 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:20.338649 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:20.380736 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32b986ac4e44819a1aca29c711e2288'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.387544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32b986ac4e44819a1aca29c711e2288'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.388211 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32b986ac4e44819a1aca29c711e2288'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.395948 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32b986ac4e44819a1aca29c711e2288'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.396609 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32b986ac4e44819a1aca29c711e2288'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.413982 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1442/2872] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:11:20 2022] DELETE /identity/v3/users/e32b986ac4e44819a1aca29c711e2288 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:20.418478 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:20.418946 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:20.419075 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:20.435431 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:20.436596 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:20.494440 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1431/2873] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:11:20.504612 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:20.506094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:20.563265 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb06b-fd41-411f-adf7-6715a21e6482 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:20.568301 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:20.568964 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:20.569271 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:20.569563 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:20.579143 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:20.581149 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:20.590484 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1443/2874] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:20.856292 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:20.857960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:20.873660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18b221-75c3-4a6b-8dc4-a673a73f9568 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:20.879247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:20.880114 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:20.880979 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:20.881274 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] PATH_INFO: `/v3/projects/e3e2dcdc9c4f472c8746315f789972de` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:20.882502 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e2dcdc9c4f472c8746315f789972de)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:20.884730 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:20.900841 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:20.932510 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e2dcdc9c4f472c8746315f789972de', 'request_id': 'req-b5d588d7-89d5-4935-9384-337f7ff05c15'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.938588 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e2dcdc9c4f472c8746315f789972de', 'request_id': 'req-b5d588d7-89d5-4935-9384-337f7ff05c15'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.944901 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e2dcdc9c4f472c8746315f789972de', 'request_id': 'req-b5d588d7-89d5-4935-9384-337f7ff05c15'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.956805 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] The token cache is being invalidate because project e3e2dcdc9c4f472c8746315f789972de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:11:20.957097 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.957721 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:20.959283 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1432/2875] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:11:20 2022] DELETE /identity/v3/projects/e3e2dcdc9c4f472c8746315f789972de => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:20.963220 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:20.973193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa40f3-b7ca-46bb-9d8d-0b147f01c155 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:21.036374 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:21.037245 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:21.037525 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:21.037833 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] PATH_INFO: `/v3/users/d85fb84856484351b7f85bf0016102c3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:21.039275 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85fb84856484351b7f85bf0016102c3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:21.041181 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:21.068776 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:21.089231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85fb84856484351b7f85bf0016102c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.096867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85fb84856484351b7f85bf0016102c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.097550 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85fb84856484351b7f85bf0016102c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.105027 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85fb84856484351b7f85bf0016102c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.105712 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85fb84856484351b7f85bf0016102c3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.124280 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1444/2876] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:11:20 2022] DELETE /identity/v3/users/d85fb84856484351b7f85bf0016102c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:21.414907 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:21.416348 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:21.429780 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d588d7-89d5-4935-9384-337f7ff05c15 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:21.489375 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:21.490192 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:21.490476 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:21.490754 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] PATH_INFO: `/v3/projects/deefc7ffb7df4b56b2444a5bc47b63ce` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:21.491956 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deefc7ffb7df4b56b2444a5bc47b63ce)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:21.493911 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:21.539660 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deefc7ffb7df4b56b2444a5bc47b63ce', 'request_id': 'req-298e197b-93c2-4a97-b667-c42986e48023'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.545634 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deefc7ffb7df4b56b2444a5bc47b63ce', 'request_id': 'req-298e197b-93c2-4a97-b667-c42986e48023'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.551122 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deefc7ffb7df4b56b2444a5bc47b63ce', 'request_id': 'req-298e197b-93c2-4a97-b667-c42986e48023'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.562929 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] The token cache is being invalidate because project deefc7ffb7df4b56b2444a5bc47b63ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:11:21.563228 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.563838 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.565328 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1433/2877] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:11:21 2022] DELETE /identity/v3/projects/deefc7ffb7df4b56b2444a5bc47b63ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:21.569278 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:21.570800 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:21.583804 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496e07-711b-4c6e-a07c-6afc59c3b190 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:21.638630 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:21.639518 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:21.639803 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:21.640079 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] PATH_INFO: `/v3/users/98e1288c8e6c4aa3abc5d70e4d20e06e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:21.641261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e1288c8e6c4aa3abc5d70e4d20e06e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:21.643739 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:21.687699 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e1288c8e6c4aa3abc5d70e4d20e06e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.694515 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e1288c8e6c4aa3abc5d70e4d20e06e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.695166 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e1288c8e6c4aa3abc5d70e4d20e06e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.702358 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e1288c8e6c4aa3abc5d70e4d20e06e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.703048 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c1b58678-790f-4459-855e-5177c61b30d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e1288c8e6c4aa3abc5d70e4d20e06e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:21.721517 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1445/2878] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:11:21 2022] DELETE /identity/v3/users/98e1288c8e6c4aa3abc5d70e4d20e06e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:21.991770 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:21.993247 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:22.006352 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e197b-93c2-4a97-b667-c42986e48023 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.036789 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:22.065005 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.065829 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.066124 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.066402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] PATH_INFO: `/v3/projects/e28029cfbffa42e594d691fe11ba3f60` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.067573 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28029cfbffa42e594d691fe11ba3f60)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.069470 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.115676 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28029cfbffa42e594d691fe11ba3f60', 'request_id': 'req-8579038a-1261-4f7f-8809-f1235111e4ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:22.121669 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28029cfbffa42e594d691fe11ba3f60', 'request_id': 'req-8579038a-1261-4f7f-8809-f1235111e4ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:22.127621 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28029cfbffa42e594d691fe11ba3f60', 'request_id': 'req-8579038a-1261-4f7f-8809-f1235111e4ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:22.139401 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] The token cache is being invalidate because project e28029cfbffa42e594d691fe11ba3f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:11:22.139687 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:22.140654 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8579038a-1261-4f7f-8809-f1235111e4ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:11:22.142618 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1434/2879] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:11:21 2022] DELETE /identity/v3/projects/e28029cfbffa42e594d691fe11ba3f60 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:22.147544 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05ed2-e94e-40f4-92e7-827ffd7851e5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.147898 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05ed2-e94e-40f4-92e7-827ffd7851e5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.148188 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da05ed2-e94e-40f4-92e7-827ffd7851e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.166021 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5da05ed2-e94e-40f4-92e7-827ffd7851e5 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:22.167229 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5da05ed2-e94e-40f4-92e7-827ffd7851e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:22.186953 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:22.227646 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1446/2880] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 10:11:22.235612 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f28fe-454e-4018-a252-39b2538d6286 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.235905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f28fe-454e-4018-a252-39b2538d6286 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.236672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f28fe-454e-4018-a252-39b2538d6286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.255131 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-318f28fe-454e-4018-a252-39b2538d6286 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:22.256589 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-318f28fe-454e-4018-a252-39b2538d6286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:22.265153 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1435/2881] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:22.269261 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da05ed2-e94e-40f4-92e7-827ffd7851e5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:22.278796 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da05ed2-e94e-40f4-92e7-827ffd7851e5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.283292 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.283944 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.284233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.284514 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.285239 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 10:11:22.285548 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.287186 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.299260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1447/2882] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Jun 3 10:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 10:11:22.304295 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f28fe-454e-4018-a252-39b2538d6286 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:22.314835 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f28fe-454e-4018-a252-39b2538d6286 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.319517 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.320104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.320389 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.320668 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.321350 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.323270 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.347969 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1436/2883] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Jun 3 10:11:22 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 10:11:22.351932 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:22.362442 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b2ac-019c-44ba-9101-103f994833ce admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.420035 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.420704 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.420995 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.421274 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.422074 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.424510 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.443923 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1448/2884] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Jun 3 10:11:22 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 10:11:22.448025 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:22.464454 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb49d55-b8c6-4e50-9057-73d96ebe5291 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.469199 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.469896 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.470186 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.471018 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.471755 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.473357 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.483728 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1437/2885] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:22.487836 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:22.497957 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7633-ac90-49cb-a72a-bd083ab66545 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.502677 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212f3e3-e45c-43fd-a768-c54032facc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.503331 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212f3e3-e45c-43fd-a768-c54032facc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.503622 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212f3e3-e45c-43fd-a768-c54032facc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.503906 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212f3e3-e45c-43fd-a768-c54032facc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.504633 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212f3e3-e45c-43fd-a768-c54032facc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.506260 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212f3e3-e45c-43fd-a768-c54032facc5b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.516096 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1449/2886] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Jun 3 10:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 10:11:22.520558 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:22.530338 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd149-1132-4640-9e6f-bded6c3ab45a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.535533 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.536408 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.536693 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.536972 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] PATH_INFO: `/v3/projects/0b18f812ac7c4c648bc2c1fb835cf7b2/users/17a5247599bc40c2a1c1893d413f5b42/roles/ad92bcd216834a4d94b428c07289fd02` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.551402 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b18f812ac7c4c648bc2c1fb835cf7b2, user_id=17a5247599bc40c2a1c1893d413f5b42, role_id=ad92bcd216834a4d94b428c07289fd02)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.554054 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.566520 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1438/2887] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Jun 3 10:11:22 2022] PUT /identity/v3/projects/0b18f812ac7c4c648bc2c1fb835cf7b2/users/17a5247599bc40c2a1c1893d413f5b42/roles/ad92bcd216834a4d94b428c07289fd02 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:11:22.571867 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af54c-6d39-4b4c-a65d-336139d34746 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.572352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af54c-6d39-4b4c-a65d-336139d34746 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.572352 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af54c-6d39-4b4c-a65d-336139d34746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.590885 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e32af54c-6d39-4b4c-a65d-336139d34746 None None] MFA Rules not processed for user `8ac41a57acdf4a3aa3f15e8d08769048`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:22.592064 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e32af54c-6d39-4b4c-a65d-336139d34746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:22.649889 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1450/2888] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:22.659965 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:22.661653 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:22.721176 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda38b4-d445-4cd7-b648-81f281bf56c5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:22.724894 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:22.725541 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:22.725863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:22.726145 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:22.735361 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:22.736795 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:22.746261 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1439/2889] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:23.346603 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4f8b-ff6e-46b0-a3a7-06ffa08d4d0e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:23.346902 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4f8b-ff6e-46b0-a3a7-06ffa08d4d0e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:23.347191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4f8b-ff6e-46b0-a3a7-06ffa08d4d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:23.373858 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-820d4f8b-ff6e-46b0-a3a7-06ffa08d4d0e None None] MFA Rules not processed for user `17a5247599bc40c2a1c1893d413f5b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:23.375001 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-820d4f8b-ff6e-46b0-a3a7-06ffa08d4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:23.394584 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:23.443024 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1451/2890] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:23.453529 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:23.454975 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:23.460317 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:23.514733 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be338a-8240-4e70-aa20-37437c51776b service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:23.518382 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795a9ecb4cd8448f81adbe68fdf967b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:23.519040 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:23.519325 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:23.519608 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:23.527998 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:23.529428 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:23.538083 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1440/2891] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:24.881326 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da1eb-1292-4668-aa67-3c2d46489e79 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:24.881840 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da1eb-1292-4668-aa67-3c2d46489e79 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:24.881969 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da1eb-1292-4668-aa67-3c2d46489e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:24.900309 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a70da1eb-1292-4668-aa67-3c2d46489e79 None None] MFA Rules not processed for user `17a5247599bc40c2a1c1893d413f5b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:24.901519 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a70da1eb-1292-4668-aa67-3c2d46489e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:24.908499 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1452/2892] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:25.145078 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:25.154610 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c884188-403c-4758-a980-7489d9ab5cfb service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:25.158703 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:25.159354 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:25.159627 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:25.159905 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:25.161675 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:25.171413 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:25.172855 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:25.181336 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1441/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:34.893960 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=21 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:35.177786 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=31 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:44.417242 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9c5a2-1187-46fb-98d6-e4ff074bb0e7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:44.417721 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9c5a2-1187-46fb-98d6-e4ff074bb0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:44.417869 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9c5a2-1187-46fb-98d6-e4ff074bb0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:44.435701 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-93a9c5a2-1187-46fb-98d6-e4ff074bb0e7 None None] MFA Rules not processed for user `17a5247599bc40c2a1c1893d413f5b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:11:44.436861 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-93a9c5a2-1187-46fb-98d6-e4ff074bb0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:44.443680 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1453/2894] 10.222.0.45 () {58 vars in 957 bytes} [Fri Jun 3 10:11:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:11:46.044459 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:46.053683 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2d5c-8469-426e-a514-05b6883fcbd6 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:46.057201 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e1b50-c0af-462b-a98a-f5ee795e4a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:46.057863 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1b50-c0af-462b-a98a-f5ee795e4a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:46.058146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1b50-c0af-462b-a98a-f5ee795e4a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:46.058421 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1b50-c0af-462b-a98a-f5ee795e4a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:46.060167 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ca2e1b50-c0af-462b-a98a-f5ee795e4a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:46.149162 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e1b50-c0af-462b-a98a-f5ee795e4a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:46.150577 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e1b50-c0af-462b-a98a-f5ee795e4a7d service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:46.171210 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1442/2895] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:47.261094 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9c5a2-1187-46fb-98d6-e4ff074bb0e7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:11:47.272774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9c5a2-1187-46fb-98d6-e4ff074bb0e7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:11:47.276426 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2585af8b95ea48d1a3576bd722536fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:11:47.277080 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:11:47.277368 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:11:47.277717 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:11:47.279773 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:11:47.294128 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:11:47.295574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:11:47.307980 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1454/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:11:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:11:56.168665 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=46 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:57.301711 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=9 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:12:07.763672 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48bc7d-fb55-4d49-b5a5-20e1c9cbffd8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:12:07.764173 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48bc7d-fb55-4d49-b5a5-20e1c9cbffd8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:12:07.764286 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48bc7d-fb55-4d49-b5a5-20e1c9cbffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:12:07.821245 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7f48bc7d-fb55-4d49-b5a5-20e1c9cbffd8 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:12:07.822457 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7f48bc7d-fb55-4d49-b5a5-20e1c9cbffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:12:07.894499 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1443/2897] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Jun 3 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:12:07.939753 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:12:07.941774 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:12:08.028574 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fd426-3c27-42df-a76b-c4f81442bf42 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:12:08.033516 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:12:08.034193 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:12:08.034479 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:12:08.034755 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:12:08.042951 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:12:08.044528 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:12:08.052849 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1455/2898] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:12:17.891423 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=44 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:12:18.049248 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=41 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:12:22.190146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0654-4a9e-4532-a212-211116006096 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:12:22.190647 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0654-4a9e-4532-a212-211116006096 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:12:22.190753 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0654-4a9e-4532-a212-211116006096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:12:22.208566 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b54a0654-4a9e-4532-a212-211116006096 None None] MFA Rules not processed for user `12d8d367b1a84e0e98a3fcdb1c979d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 10:12:22.209845 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b54a0654-4a9e-4532-a212-211116006096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:12:22.216936 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1444/2899] 10.222.0.45 () {58 vars in 967 bytes} [Fri Jun 3 10:12:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 10:12:22.229231 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:12:22.240037 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c7711-d981-481f-b9ea-85d4226a87bd service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:12:22.245116 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8474647dd40b0add7fdba5f24e3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:12:22.245737 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:12:22.246044 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:12:22.246344 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:12:22.254197 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:12:22.255863 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:12:22.264233 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1456/2900] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Jun 3 10:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 10:12:24.152797 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a0654-4a9e-4532-a212-211116006096 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:12:24.164635 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a0654-4a9e-4532-a212-211116006096 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:12:24.169550 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:12:24.170390 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:12:24.170678 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:12:24.170960 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] PATH_INFO: `/v3/users/17a5247599bc40c2a1c1893d413f5b42` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:12:24.172172 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a5247599bc40c2a1c1893d413f5b42)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:12:24.174100 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:12:24.221890 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a5247599bc40c2a1c1893d413f5b42'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.228629 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a5247599bc40c2a1c1893d413f5b42'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.229289 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a5247599bc40c2a1c1893d413f5b42'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.236623 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a5247599bc40c2a1c1893d413f5b42'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.237290 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a5247599bc40c2a1c1893d413f5b42'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.254776 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1445/2901] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Jun 3 10:12:24 2022] DELETE /identity/v3/users/17a5247599bc40c2a1c1893d413f5b42 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:12:24.428353 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:12:24.438786 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a6fb-8d39-4992-b14c-d78b62281798 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:12:24.495966 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac41a57acdf4a3aa3f15e8d08769048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a9104f36ddb422fa7bc883d1d00818c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:12:24.496760 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:12:24.497045 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:12:24.497320 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] PATH_INFO: `/v3/projects/0b18f812ac7c4c648bc2c1fb835cf7b2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:12:24.498526 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b18f812ac7c4c648bc2c1fb835cf7b2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:12:24.500421 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:12:24.545478 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'request_id': 'req-ec921a6a-67bd-4acb-868a-cb9afccb7acd'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.551667 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'request_id': 'req-ec921a6a-67bd-4acb-868a-cb9afccb7acd'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.559191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'request_id': 'req-ec921a6a-67bd-4acb-868a-cb9afccb7acd'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.570904 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] The token cache is being invalidate because project 0b18f812ac7c4c648bc2c1fb835cf7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 10:12:24.571191 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.571814 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ec921a6a-67bd-4acb-868a-cb9afccb7acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 10:12:24.573336 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1457/2902] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Jun 3 10:12:24 2022] DELETE /identity/v3/projects/0b18f812ac7c4c648bc2c1fb835cf7b2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 10:12:34.250731 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:12:34.567938 dv-cinder-797608-29-iscsi devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:15:57.775662 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 10:15:57.777104 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:15:57.845991 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03eb5ab-6d01-4e25-b1fc-058ff6d9463c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 10:15:57.903251 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac64e0b-ac66-4461-9916-eed819f38477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c559aafd5f4ebdbc3bb654926d2c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc79d0d649b647a8b7b78b29ac8ca319', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 10:15:57.903898 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64e0b-ac66-4461-9916-eed819f38477 service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 10:15:57.904189 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64e0b-ac66-4461-9916-eed819f38477 service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 10:15:57.904509 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64e0b-ac66-4461-9916-eed819f38477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 10:15:57.906345 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5ac64e0b-ac66-4461-9916-eed819f38477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 10:15:57.918146 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac64e0b-ac66-4461-9916-eed819f38477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 10:15:57.919726 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac64e0b-ac66-4461-9916-eed819f38477 service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 10:15:57.929997 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1446/2903] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Jun 3 10:15:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 10:16:07.925794 dv-cinder-797608-29-iscsi devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=58 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}